Aug 17 10:07:10 user nova-compute[73158]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 10:07:13 user nova-compute[73158]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73158) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73158) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73158) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 10:07:13 user nova-compute[73158]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:07:13 user nova-compute[73158]: INFO nova.virt.driver [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 10:07:13 user nova-compute[73158]: INFO nova.compute.provider_config [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Acquiring lock "singleton_lock" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Acquired lock "singleton_lock" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Releasing lock "singleton_lock" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Full set of CONF: {{(pid=73158) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ******************************************************************************** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Configuration options gathered from: {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ================================================================================ {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] allow_resize_to_same_host      = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] arq_binding_timeout            = 300 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] backdoor_port                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] backdoor_socket                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] block_device_allocate_retries  = 300 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] block_device_allocate_retries_interval = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cert                           = self.pem {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute_monitors               = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] config_dir                     = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] config_drive_format            = iso9660 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] config_source                  = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] console_host                   = user {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] control_exchange               = nova {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cpu_allocation_ratio           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] daemon                         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] debug                          = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] default_access_ip_network_name = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] default_availability_zone      = nova {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] default_ephemeral_format       = ext4 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] default_schedule_zone          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] disk_allocation_ratio          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] enable_new_services            = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] enabled_apis                   = ['osapi_compute'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] enabled_ssl_apis               = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] flat_injected                  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] force_config_drive             = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] force_raw_images               = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] graceful_shutdown_timeout      = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] heal_instance_info_cache_interval = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] host                           = user {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_build_timeout         = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_delete_interval       = 300 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_format                = [instance: %(uuid)s]  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_name_template         = instance-%08x {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_usage_audit           = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_usage_audit_period    = month {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] internal_service_availability_zone = internal {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] key                            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] live_migration_retry_count     = 30 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_config_append              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_dir                        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_file                       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_options                    = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_rotate_interval            = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_rotate_interval_type       = days {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] log_rotation_type              = none {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] long_rpc_timeout               = 1800 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] max_concurrent_builds          = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] max_concurrent_live_migrations = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] max_concurrent_snapshots       = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] max_local_block_devices        = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] max_logfile_count              = 30 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] max_logfile_size_mb            = 200 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] maximum_instance_delete_attempts = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metadata_listen                = 0.0.0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metadata_listen_port           = 8775 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metadata_workers               = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] migrate_max_retries            = -1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] mkisofs_cmd                    = genisoimage {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] my_ip                          = 10.0.0.210 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] network_allocate_retries       = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] osapi_compute_listen_port      = 8774 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] osapi_compute_unique_server_name_scope =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] osapi_compute_workers          = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] password_length                = 12 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] periodic_enable                = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] periodic_fuzzy_delay           = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] pointer_model                  = ps2mouse {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] preallocate_images             = none {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] publish_errors                 = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] pybasedir                      = /opt/stack/nova {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ram_allocation_ratio           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rate_limit_burst               = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rate_limit_except_level        = CRITICAL {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rate_limit_interval            = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reboot_timeout                 = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reclaim_instance_interval      = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] record                         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reimage_timeout_per_gb         = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] report_interval                = 120 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rescue_timeout                 = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reserved_host_cpus             = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reserved_host_disk_mb          = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reserved_host_memory_mb        = 512 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] reserved_huge_pages            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] resize_confirm_window          = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] resize_fs_using_block_device   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] resume_guests_state_on_host_boot = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rpc_response_timeout           = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] run_external_periodic_tasks    = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] running_deleted_instance_action = reap {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] running_deleted_instance_poll_interval = 1800 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] running_deleted_instance_timeout = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler_instance_sync_interval = 120 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_down_time              = 720 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] servicegroup_driver            = db {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] shelved_offload_time           = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] shelved_poll_interval          = 3600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] shutdown_timeout               = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] source_is_ipv6                 = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ssl_only                       = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] state_path                     = /opt/stack/data/nova {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] sync_power_state_interval      = 600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] sync_power_state_pool_size     = 1000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] syslog_log_facility            = LOG_USER {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] tempdir                        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] timeout_nbd                    = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] transport_url                  = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] update_resources_interval      = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_cow_images                 = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_eventlog                   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_journal                    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_json                       = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_rootwrap_daemon            = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_stderr                     = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] use_syslog                     = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vcpu_pin_set                   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plugging_is_fatal          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plugging_timeout           = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] virt_mkfs                      = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] volume_usage_poll_interval     = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] watch_log_file                 = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] web                            = /usr/share/spice-html5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_concurrency.disable_process_locking = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.auth_strategy              = keystone {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.compute_link_prefix        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.dhcp_domain                = novalocal {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.enable_instance_password   = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.glance_link_prefix         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.instance_list_per_project_cells = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.list_records_by_skipping_down_cells = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.local_metadata_per_cell    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.max_limit                  = 1000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.metadata_cache_expiration  = 15 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.neutron_default_tenant_id  = default {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.use_forwarded_for          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.use_neutron_default_nets   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_dynamic_targets = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_jsonfile_path   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.backend                  = dogpile.cache.memcached {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.backend_argument         = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.config_prefix            = cache.oslo {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.dead_timeout             = 60.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.debug_cache_backend      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.enable_retry_client      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.enable_socket_keepalive  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.enabled                  = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.expiration_time          = 600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.hashclient_retry_attempts = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_dead_retry      = 300 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_password        =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_pool_maxsize    = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_sasl_enabled    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.memcache_username        =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.proxies                  = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.retry_attempts           = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.retry_delay              = 0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.socket_keepalive_count   = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.socket_keepalive_idle    = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.socket_keepalive_interval = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.tls_allowed_ciphers      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.tls_cafile               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.tls_certfile             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.tls_enabled              = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cache.tls_keyfile              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.auth_section            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.auth_type               = password {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.cafile                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.certfile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.collect_timing          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.cross_az_attach         = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.debug                   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.endpoint_template       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.http_retries            = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.insecure                = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.keyfile                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.os_region_name          = RegionOne {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.split_loggers           = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cinder.timeout                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.cpu_dedicated_set      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.cpu_shared_set         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.image_type_exclude_list = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.max_concurrent_disk_ops = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.max_disk_devices_to_attach = -1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.resource_provider_association_refresh = 300 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.shutdown_retry_interval = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] conductor.workers              = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] console.allowed_origins        = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] console.ssl_ciphers            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] console.ssl_minimum_version    = default {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] consoleauth.token_ttl          = 600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.cafile                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.certfile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.collect_timing          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.connect_retries         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.connect_retry_delay     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.endpoint_override       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.insecure                = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.keyfile                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.max_version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.min_version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.region_name             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.service_name            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.service_type            = accelerator {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.split_loggers           = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.status_code_retries     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.timeout                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] cyborg.version                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.backend               = sqlalchemy {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.connection            = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.connection_debug      = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.connection_parameters =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.connection_recycle_time = 3600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.connection_trace      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.db_inc_retry_interval = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.db_max_retries        = 20 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.db_max_retry_interval = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.db_retry_interval     = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.max_overflow          = 50 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.max_pool_size         = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.max_retries           = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.mysql_enable_ndb      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.mysql_wsrep_sync_wait = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.pool_timeout          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.retry_interval        = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.slave_connection      = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] database.sqlite_synchronous    = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.backend           = sqlalchemy {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.connection        = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.connection_debug  = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.connection_parameters =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.connection_recycle_time = 3600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.connection_trace  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.db_inc_retry_interval = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.db_max_retries    = 20 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.db_max_retry_interval = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.db_retry_interval = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.max_overflow      = 50 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.max_pool_size     = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.max_retries       = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.mysql_enable_ndb  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.pool_timeout      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.retry_interval    = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.slave_connection  = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] api_database.sqlite_synchronous = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] devices.enabled_mdev_types     = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ephemeral_storage_encryption.enabled = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.api_servers             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.cafile                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.certfile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.collect_timing          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.connect_retries         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.connect_retry_delay     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.debug                   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.default_trusted_certificate_ids = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.enable_certificate_validation = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.enable_rbd_download     = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.endpoint_override       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.insecure                = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.keyfile                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.max_version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.min_version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.num_retries             = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.rbd_ceph_conf           =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.rbd_connect_timeout     = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.rbd_pool                =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.rbd_user                =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.region_name             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.service_name            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.service_type            = image {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.split_loggers           = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.status_code_retries     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.timeout                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.verify_glance_signatures = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] glance.version                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] guestfs.debug                  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.config_drive_cdrom      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.config_drive_inject_password = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.enable_instance_metrics_collection = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.enable_remotefx         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.instances_path_share    =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.iscsi_initiator_list    = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.limit_cpu_features      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.power_state_check_timeframe = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.use_multipath_io        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.volume_attach_retry_count = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.vswitch_name            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] mks.enabled                    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] image_cache.manager_interval   = 2400 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] image_cache.precache_concurrency = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] image_cache.remove_unused_base_images = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] image_cache.subdirectory_name  = _base {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.api_max_retries         = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.api_retry_interval      = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.auth_section            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.auth_type               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.cafile                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.certfile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.collect_timing          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.connect_retries         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.connect_retry_delay     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.endpoint_override       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.insecure                = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.keyfile                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.max_version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.min_version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.partition_key           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.peer_list               = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.region_name             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.serial_console_state_timeout = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.service_name            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.service_type            = baremetal {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.split_loggers           = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.status_code_retries     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.timeout                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ironic.version                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] key_manager.fixed_key          = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.barbican_api_version  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.barbican_endpoint     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.barbican_endpoint_type = public {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.barbican_region_name  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.cafile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.certfile              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.collect_timing        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.insecure              = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.keyfile               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.number_of_retries     = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.retry_delay           = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.send_service_user_token = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.split_loggers         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.timeout               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.verify_ssl            = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican.verify_ssl_path       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.auth_section = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.auth_type = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.cafile   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.certfile = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.collect_timing = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.insecure = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.keyfile  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.split_loggers = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] barbican_service_user.timeout  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.approle_role_id          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.approle_secret_id        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.cafile                   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.certfile                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.collect_timing           = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.insecure                 = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.keyfile                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.kv_mountpoint            = secret {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.kv_version               = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.namespace                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.root_token_id            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.split_loggers            = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.ssl_ca_crt_file          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.timeout                  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.use_ssl                  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.cafile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.certfile              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.collect_timing        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.connect_retries       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.connect_retry_delay   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.endpoint_override     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.insecure              = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.keyfile               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.max_version           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.min_version           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.region_name           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.service_name          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.service_type          = identity {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.split_loggers         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.status_code_retries   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.timeout               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] keystone.version               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.connection_uri         =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_mode               = custom {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: WARNING oslo_config.cfg [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_power_governor_high = performance {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_power_governor_low = powersave {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_power_management   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.device_detach_attempts = 8 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.device_detach_timeout  = 20 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.disk_cachemodes        = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.disk_prefix            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.enabled_perf_events    = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.file_backed_memory     = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.gid_maps               = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.hw_disk_discard        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.hw_machine_type        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_rbd_glance_store_name =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_rbd_pool        = rbd {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_type            = default {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.images_volume_group    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.inject_key             = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.inject_partition       = -2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.inject_password        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.iscsi_iface            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.iser_use_multipath     = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_bandwidth = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_downtime = 500 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_inbound_addr = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_permit_post_copy = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_scheme  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_timeout_action = abort {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_tunnelled = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: WARNING oslo_config.cfg [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 10:07:13 user nova-compute[73158]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 10:07:13 user nova-compute[73158]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 10:07:13 user nova-compute[73158]: and ``live_migration_inbound_addr`` respectively.
Aug 17 10:07:13 user nova-compute[73158]: ).  Its value may be silently ignored in the future.
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.live_migration_with_native_tls = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.max_queues             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.nfs_mount_options      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.num_memory_encrypted_guests = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.num_pcie_ports         = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.pmem_namespaces        = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.quobyte_client_cfg     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rbd_secret_uuid        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rbd_user               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.remote_filesystem_transport = ssh {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rescue_image_id        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rescue_kernel_id       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rescue_ramdisk_id      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.rx_queue_size          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.smbfs_mount_options    =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.snapshot_compression   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.snapshot_image_format  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.sparse_logical_volumes = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.swtpm_enabled          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.swtpm_group            = tss {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.swtpm_user             = tss {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.sysinfo_serial         = unique {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.tb_cache_size          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.tx_queue_size          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.uid_maps               = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.use_virtio_for_bridges = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.virt_type              = kvm {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.volume_clear           = zero {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.volume_clear_size      = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.volume_use_multipath   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_cache_path   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.vzstorage_mount_user   = stack {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.auth_section           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.auth_type              = password {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.cafile                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.certfile               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.collect_timing         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.connect_retries        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.connect_retry_delay    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.default_floating_pool  = public {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.endpoint_override      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.extension_sync_interval = 600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.http_retries           = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.insecure               = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.keyfile                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.max_version            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.min_version            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.ovs_bridge             = br-int {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.physnets               = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.region_name            = RegionOne {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.service_metadata_proxy = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.service_name           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.service_type           = network {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.split_loggers          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.status_code_retries    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.timeout                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] neutron.version                = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] notifications.bdms_in_notifications = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] notifications.default_level    = INFO {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] notifications.notification_format = unversioned {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] notifications.notify_on_state_change = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] pci.alias                      = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] pci.device_spec                = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] pci.report_in_placement        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.auth_section         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.auth_type            = password {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.cafile               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.certfile             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.collect_timing       = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.connect_retries      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.connect_retry_delay  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.default_domain_id    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.default_domain_name  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.domain_id            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.domain_name          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.endpoint_override    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.insecure             = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.keyfile              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.max_version          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.min_version          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.password             = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.project_domain_id    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.project_domain_name  = Default {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.project_id           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.project_name         = service {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.region_name          = RegionOne {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.service_name         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.service_type         = placement {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.split_loggers        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.status_code_retries  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.system_scope         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.timeout              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.trust_id             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.user_domain_id       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.user_domain_name     = Default {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.user_id              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.username             = placement {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] placement.version              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.cores                    = 20 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.count_usage_from_placement = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.injected_file_content_bytes = 10240 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.injected_file_path_length = 255 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.injected_files           = 5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.instances                = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.key_pairs                = 100 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.metadata_items           = 128 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.ram                      = 51200 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.recheck_quota            = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.server_group_members     = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] quota.server_groups            = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rdp.enabled                    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.image_metadata_prefilter = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.max_attempts         = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.max_placement_results = 1000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.query_placement_for_availability_zone = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.query_placement_for_image_type_support = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] scheduler.workers              = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.host_subset_size = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.isolated_hosts = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.isolated_images = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.pci_in_placement = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.track_instance_changes = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metrics.required               = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metrics.weight_multiplier      = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] metrics.weight_setting         = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] serial_console.enabled         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] serial_console.port_range      = 10000:20000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] serial_console.serialproxy_port = 6083 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.auth_section      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.auth_type         = password {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.cafile            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.certfile          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.collect_timing    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.insecure          = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.keyfile           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.send_service_user_token = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.split_loggers     = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] service_user.timeout           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.agent_enabled            = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.enabled                  = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.html5proxy_port          = 6082 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.image_compression        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.jpeg_compression         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.playback_compression     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.server_listen            = 127.0.0.1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.streaming_mode           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] spice.zlib_compression         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] upgrade_levels.baseapi         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] upgrade_levels.cert            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] upgrade_levels.compute         = auto {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] upgrade_levels.conductor       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] upgrade_levels.scheduler       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.auth_section = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.auth_type = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.cafile = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.certfile = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.insecure = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.keyfile = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vendordata_dynamic_auth.timeout = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.api_retry_count         = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.ca_file                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.cache_prefix            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.cluster_name            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.connection_pool_size    = 10 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.console_delay_seconds   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.datastore_regex         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.host_ip                 = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.host_password           = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.host_port               = 443 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.host_username           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.insecure                = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.integration_bridge      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.maximum_objects         = 100 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.pbm_default_policy      = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.pbm_enabled             = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.pbm_wsdl_location       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.serial_port_proxy_uri   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.serial_port_service_uri = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.task_poll_interval      = 0.5 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.use_linked_clone        = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.vnc_keymap              = en-us {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.vnc_port                = 5900 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vmware.vnc_port_total          = 10000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.auth_schemes               = ['none'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.enabled                    = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.novncproxy_port            = 6080 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.server_listen              = 0.0.0.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.vencrypt_ca_certs          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.vencrypt_client_cert       = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vnc.vencrypt_client_key        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.disable_rootwrap   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.enable_numa_live_migration = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.libvirt_disable_apic = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.client_socket_timeout     = 900 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.default_pool_size         = 1000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.keep_alive                = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.max_header_line           = 16384 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.ssl_ca_file               = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.ssl_cert_file             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.ssl_key_file              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.tcp_keepidle              = 600 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] zvm.ca_file                    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] zvm.cloud_connector_url        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] zvm.reachable_timeout          = 300 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.enforce_new_defaults = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.enforce_scope      = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.policy_default_rule = default {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.policy_file        = policy.yaml {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.connection_string     = messaging:// {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.enabled               = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.es_doc_type           = notification {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.es_scroll_size        = 10000 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.es_scroll_time        = 2m {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.filter_error_trace    = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.hmac_keys             = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.sentinel_service_name = mymaster {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.socket_timeout        = 0.1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.trace_requests        = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler.trace_sqlalchemy      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler_jaeger.process_tags   = {} {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler_jaeger.service_name_prefix = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] profiler_otlp.service_name_prefix = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] remote_debug.host              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] remote_debug.port              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.ssl      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_notifications.retry = -1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_messaging_notifications.transport_url = **** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.auth_section        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.auth_type           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.cafile              = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.certfile            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.collect_timing      = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.connect_retries     = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.connect_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.endpoint_id         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.endpoint_override   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.insecure            = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.keyfile             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.max_version         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.min_version         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.region_name         = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.service_name        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.service_type        = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.split_loggers       = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.status_code_retries = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.status_code_retry_delay = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.timeout             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.valid_interfaces    = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_limit.version             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_reports.file_event_handler = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] oslo_reports.log_dir           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_ovs_privileged.group  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] vif_plug_ovs_privileged.user   = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.flat_interface = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_ovs.isolate_vif         = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_vif_ovs.per_port_bridge     = False {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] os_brick.lock_path             = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] privsep_osbrick.capabilities   = [21] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] privsep_osbrick.group          = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] privsep_osbrick.helper_command = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] privsep_osbrick.user           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] nova_sys_admin.group           = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] nova_sys_admin.helper_command  = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] nova_sys_admin.user            = None {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 10:07:13 user nova-compute[73158]: DEBUG oslo_service.service [None req-66be7424-947c-483c-9e14-310fc7c0f3ac None None] ******************************************************************************** {{(pid=73158) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 10:07:13 user nova-compute[73158]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Starting native event thread {{(pid=73158) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Starting green dispatch thread {{(pid=73158) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Starting connection event dispatch thread {{(pid=73158) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Connecting to libvirt: qemu:///system {{(pid=73158) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fcc3cee0f70> {{(pid=73158) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fcc3cee0f70> {{(pid=73158) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 10:07:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Connection event '1' reason 'None'
Aug 17 10:07:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 10:07:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.mount [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Initialising _HostMountState generation 0 {{(pid=73158) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 10:07:21 user nova-compute[73158]: INFO nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host capabilities <capabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <host>
Aug 17 10:07:21 user nova-compute[73158]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 10:07:21 user nova-compute[73158]:     <cpu>
Aug 17 10:07:21 user nova-compute[73158]:       <arch>x86_64</arch>
Aug 17 10:07:21 user nova-compute[73158]:       <model>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <microcode version='1070'/>
Aug 17 10:07:21 user nova-compute[73158]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='osxsave'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='invtsc'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='rsba'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 10:07:21 user nova-compute[73158]:       <pages unit='KiB' size='4'/>
Aug 17 10:07:21 user nova-compute[73158]:       <pages unit='KiB' size='2048'/>
Aug 17 10:07:21 user nova-compute[73158]:     </cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <power_management>
Aug 17 10:07:21 user nova-compute[73158]:       <suspend_mem/>
Aug 17 10:07:21 user nova-compute[73158]:       <suspend_disk/>
Aug 17 10:07:21 user nova-compute[73158]:       <suspend_hybrid/>
Aug 17 10:07:21 user nova-compute[73158]:     </power_management>
Aug 17 10:07:21 user nova-compute[73158]:     <iommu support='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <migration_features>
Aug 17 10:07:21 user nova-compute[73158]:       <live/>
Aug 17 10:07:21 user nova-compute[73158]:       <uri_transports>
Aug 17 10:07:21 user nova-compute[73158]:         <uri_transport>tcp</uri_transport>
Aug 17 10:07:21 user nova-compute[73158]:         <uri_transport>rdma</uri_transport>
Aug 17 10:07:21 user nova-compute[73158]:       </uri_transports>
Aug 17 10:07:21 user nova-compute[73158]:     </migration_features>
Aug 17 10:07:21 user nova-compute[73158]:     <topology>
Aug 17 10:07:21 user nova-compute[73158]:       <cells num='2'>
Aug 17 10:07:21 user nova-compute[73158]:         <cell id='0'>
Aug 17 10:07:21 user nova-compute[73158]:           <memory unit='KiB'>8140616</memory>
Aug 17 10:07:21 user nova-compute[73158]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 17 10:07:21 user nova-compute[73158]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 10:07:21 user nova-compute[73158]:           <distances>
Aug 17 10:07:21 user nova-compute[73158]:             <sibling id='0' value='10'/>
Aug 17 10:07:21 user nova-compute[73158]:             <sibling id='1' value='20'/>
Aug 17 10:07:21 user nova-compute[73158]:           </distances>
Aug 17 10:07:21 user nova-compute[73158]:           <cpus num='6'>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 10:07:21 user nova-compute[73158]:           </cpus>
Aug 17 10:07:21 user nova-compute[73158]:         </cell>
Aug 17 10:07:21 user nova-compute[73158]:         <cell id='1'>
Aug 17 10:07:21 user nova-compute[73158]:           <memory unit='KiB'>8255068</memory>
Aug 17 10:07:21 user nova-compute[73158]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 17 10:07:21 user nova-compute[73158]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 10:07:21 user nova-compute[73158]:           <distances>
Aug 17 10:07:21 user nova-compute[73158]:             <sibling id='0' value='20'/>
Aug 17 10:07:21 user nova-compute[73158]:             <sibling id='1' value='10'/>
Aug 17 10:07:21 user nova-compute[73158]:           </distances>
Aug 17 10:07:21 user nova-compute[73158]:           <cpus num='6'>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 10:07:21 user nova-compute[73158]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 10:07:21 user nova-compute[73158]:           </cpus>
Aug 17 10:07:21 user nova-compute[73158]:         </cell>
Aug 17 10:07:21 user nova-compute[73158]:       </cells>
Aug 17 10:07:21 user nova-compute[73158]:     </topology>
Aug 17 10:07:21 user nova-compute[73158]:     <cache>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 10:07:21 user nova-compute[73158]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 10:07:21 user nova-compute[73158]:     </cache>
Aug 17 10:07:21 user nova-compute[73158]:     <secmodel>
Aug 17 10:07:21 user nova-compute[73158]:       <model>apparmor</model>
Aug 17 10:07:21 user nova-compute[73158]:       <doi>0</doi>
Aug 17 10:07:21 user nova-compute[73158]:     </secmodel>
Aug 17 10:07:21 user nova-compute[73158]:     <secmodel>
Aug 17 10:07:21 user nova-compute[73158]:       <model>dac</model>
Aug 17 10:07:21 user nova-compute[73158]:       <doi>0</doi>
Aug 17 10:07:21 user nova-compute[73158]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 10:07:21 user nova-compute[73158]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 10:07:21 user nova-compute[73158]:     </secmodel>
Aug 17 10:07:21 user nova-compute[73158]:   </host>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='alpha'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>clipper</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='armv6l'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>spitz</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>nuri</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>kzm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sx1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>z2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>tosa</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>n810</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>n800</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>terrier</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>midway</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>microbit</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>verdex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>highbank</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>akita</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>connex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>collie</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='armv7l'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>spitz</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>nuri</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>kzm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sx1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>z2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>tosa</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>n810</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>n800</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>terrier</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>midway</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>microbit</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>verdex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>highbank</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>akita</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>connex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>collie</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='aarch64'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>spitz</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>nuri</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>kzm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sx1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>z2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>tosa</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>n810</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>n800</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>terrier</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>midway</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>microbit</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>verdex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>highbank</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>akita</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>connex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>collie</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <acpi default='on' toggle='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='cris'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='i686'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>isapc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>microvm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='kvm'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <pae/>
Aug 17 10:07:21 user nova-compute[73158]:       <nonpae/>
Aug 17 10:07:21 user nova-compute[73158]:       <acpi default='on' toggle='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:       <apic default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='m68k'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>an5206</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>q800</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='microblaze'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='microblazeel'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='mips'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='16'>malta</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='mipsel'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='16'>malta</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='mips64'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='16'>malta</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>pica61</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>magnum</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='mips64el'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='16'>malta</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>pica61</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>magnum</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='16'>boston</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='ppc'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mac99</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>40p</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>taihu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='ppc64'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>taihu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>40p</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mac99</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='ppc64le'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>taihu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>40p</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>mac99</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='riscv32'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='8'>spike</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='8'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='riscv64'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='8'>spike</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='8'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='s390x'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='sh4'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>shix</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>r2d</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='sh4eb'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>shix</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>r2d</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='sparc'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>LX</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='sparc64'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>niagara</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='x86_64'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>64</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='1'>isapc</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>microvm</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='kvm'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <acpi default='on' toggle='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:       <apic default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='xtensa'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>sim</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>kc705</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ml605</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx200</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx60</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]:   <guest>
Aug 17 10:07:21 user nova-compute[73158]:     <os_type>hvm</os_type>
Aug 17 10:07:21 user nova-compute[73158]:     <arch name='xtensaeb'>
Aug 17 10:07:21 user nova-compute[73158]:       <wordsize>32</wordsize>
Aug 17 10:07:21 user nova-compute[73158]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='4'>sim</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>kc705</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ml605</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>virt</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx200</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>lx60</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 10:07:21 user nova-compute[73158]:       <domain type='qemu'/>
Aug 17 10:07:21 user nova-compute[73158]:     </arch>
Aug 17 10:07:21 user nova-compute[73158]:     <features>
Aug 17 10:07:21 user nova-compute[73158]:       <cpuselection/>
Aug 17 10:07:21 user nova-compute[73158]:       <deviceboot/>
Aug 17 10:07:21 user nova-compute[73158]:       <disksnapshot default='on' toggle='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     </features>
Aug 17 10:07:21 user nova-compute[73158]:   </guest>
Aug 17 10:07:21 user nova-compute[73158]: </capabilities>
Aug 17 10:07:21 user nova-compute[73158]: 
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-i440fx-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>i686</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='255'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'/>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='lm'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ide</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-q35-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>i686</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='288'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'/>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='lm'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-i440fx-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>i686</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='255'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'/>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='lm'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ide</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-q35-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>i686</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='288'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'/>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='lm'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-i440fx-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>x86_64</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='255'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>efi</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='invtsc'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='rsba'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ide</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-q35-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>x86_64</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='288'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>efi</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='invtsc'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='rsba'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-i440fx-jammy</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>x86_64</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='255'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>efi</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='invtsc'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='rsba'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ide</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 10:07:21 user nova-compute[73158]: <domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 10:07:21 user nova-compute[73158]:   <domain>kvm</domain>
Aug 17 10:07:21 user nova-compute[73158]:   <machine>pc-q35-6.2</machine>
Aug 17 10:07:21 user nova-compute[73158]:   <arch>x86_64</arch>
Aug 17 10:07:21 user nova-compute[73158]:   <vcpu max='288'/>
Aug 17 10:07:21 user nova-compute[73158]:   <iothreads supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:   <os supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='firmware'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>efi</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:     <loader supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>rom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pflash</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='readonly'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='secure'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>yes</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>no</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </loader>
Aug 17 10:07:21 user nova-compute[73158]:   </os>
Aug 17 10:07:21 user nova-compute[73158]:   <cpu>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-passthrough' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='hostPassthroughMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='maximum' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='maximumMigratable'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>on</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>off</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='host-model' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <vendor>Intel</vendor>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ss'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='vmx'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pcid'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='hypervisor'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arat'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='umip'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='md-clear'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='invtsc'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibpb'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='ibrs'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-stibp'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='rsba'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='erms'/>
Aug 17 10:07:21 user nova-compute[73158]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:     <mode name='custom' supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>qemu64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>qemu32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>phenom</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>pentium</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>n270</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm64</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>kvm32</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>coreduo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>core2duo</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>athlon</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Westmere</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Snowridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Skylake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>SandyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Penryn</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G5</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G4</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G3</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Opteron_G2</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Opteron_G1</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>IvyBridge</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Icelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Haswell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Rome</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-Milan</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>EPYC</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Dhyana</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cooperlake</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>Conroe</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='no'>Broadwell</model>
Aug 17 10:07:21 user nova-compute[73158]:       <model usable='yes'>486</model>
Aug 17 10:07:21 user nova-compute[73158]:     </mode>
Aug 17 10:07:21 user nova-compute[73158]:   </cpu>
Aug 17 10:07:21 user nova-compute[73158]:   <memoryBacking supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:     <enum name='sourceType'>
Aug 17 10:07:21 user nova-compute[73158]:       <value>file</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>anonymous</value>
Aug 17 10:07:21 user nova-compute[73158]:       <value>memfd</value>
Aug 17 10:07:21 user nova-compute[73158]:     </enum>
Aug 17 10:07:21 user nova-compute[73158]:   </memoryBacking>
Aug 17 10:07:21 user nova-compute[73158]:   <devices>
Aug 17 10:07:21 user nova-compute[73158]:     <disk supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='diskDevice'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>disk</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cdrom</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>floppy</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>lun</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='bus'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>fdc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sata</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </disk>
Aug 17 10:07:21 user nova-compute[73158]:     <graphics supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='type'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>sdl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vnc</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>spice</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egl-headless</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </graphics>
Aug 17 10:07:21 user nova-compute[73158]:     <video supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='modelType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>cirrus</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>vmvga</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>qxl</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>none</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>bochs</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>ramfb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </video>
Aug 17 10:07:21 user nova-compute[73158]:     <hostdev supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='mode'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>subsystem</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='startupPolicy'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>default</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>mandatory</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>requisite</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>optional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='subsysType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>usb</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>pci</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>scsi</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='capsType'/>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='pciBackend'/>
Aug 17 10:07:21 user nova-compute[73158]:     </hostdev>
Aug 17 10:07:21 user nova-compute[73158]:     <rng supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtio-non-transitional</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>random</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>egd</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>builtin</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </rng>
Aug 17 10:07:21 user nova-compute[73158]:     <filesystem supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='driverType'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>path</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>handle</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>virtiofs</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </filesystem>
Aug 17 10:07:21 user nova-compute[73158]:     <tpm supported='yes'>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='model'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-tis</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>tpm-crb</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:       <enum name='backendModel'>
Aug 17 10:07:21 user nova-compute[73158]:         <value>passthrough</value>
Aug 17 10:07:21 user nova-compute[73158]:         <value>emulator</value>
Aug 17 10:07:21 user nova-compute[73158]:       </enum>
Aug 17 10:07:21 user nova-compute[73158]:     </tpm>
Aug 17 10:07:21 user nova-compute[73158]:   </devices>
Aug 17 10:07:21 user nova-compute[73158]:   <features>
Aug 17 10:07:21 user nova-compute[73158]:     <gic supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:     <vmcoreinfo supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <genid supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backingStoreInput supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <backup supported='yes'/>
Aug 17 10:07:21 user nova-compute[73158]:     <sev supported='no'/>
Aug 17 10:07:21 user nova-compute[73158]:   </features>
Aug 17 10:07:21 user nova-compute[73158]: </domainCapabilities>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73158) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73158) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Checking secure boot support for host arch (x86_64) {{(pid=73158) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Checking secure boot support for host arch (x86_64) {{(pid=73158) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Checking secure boot support for host arch (x86_64) {{(pid=73158) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 10:07:21 user nova-compute[73158]: INFO nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Secure Boot support detected
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] cpu compare xml: <cpu match="exact">
Aug 17 10:07:21 user nova-compute[73158]:   <model>Nehalem</model>
Aug 17 10:07:21 user nova-compute[73158]: </cpu>
Aug 17 10:07:21 user nova-compute[73158]:  {{(pid=73158) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 10:07:21 user nova-compute[73158]: INFO nova.virt.node [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Generated node identity 6683a228-d116-40aa-bd44-73677ce911ae
Aug 17 10:07:21 user nova-compute[73158]: INFO nova.virt.node [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Wrote node identity 6683a228-d116-40aa-bd44-73677ce911ae to /opt/stack/data/nova/compute_id
Aug 17 10:07:21 user nova-compute[73158]: WARNING nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Compute nodes ['6683a228-d116-40aa-bd44-73677ce911ae'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 10:07:21 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 10:07:21 user nova-compute[73158]: WARNING nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 10:07:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:07:21 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:07:22 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:07:22 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Hypervisor/Node resource view: name=user free_ram=10790MB free_disk=25.246089935302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:07:22 user nova-compute[73158]: WARNING nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] No compute node record for user:6683a228-d116-40aa-bd44-73677ce911ae: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6683a228-d116-40aa-bd44-73677ce911ae could not be found.
Aug 17 10:07:22 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Compute node record created for user:user with uuid: 6683a228-d116-40aa-bd44-73677ce911ae
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:07:22 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [req-36261daf-479e-4307-bf89-d55fdb815971] Created resource provider record via placement API for resource provider with UUID 6683a228-d116-40aa-bd44-73677ce911ae and name user.
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73158) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 10:07:22 user nova-compute[73158]: INFO nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] kernel doesn't support AMD SEV
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Libvirt baseline CPU <cpu>
Aug 17 10:07:22 user nova-compute[73158]:   <arch>x86_64</arch>
Aug 17 10:07:22 user nova-compute[73158]:   <model>Nehalem</model>
Aug 17 10:07:22 user nova-compute[73158]:   <vendor>Intel</vendor>
Aug 17 10:07:22 user nova-compute[73158]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 10:07:22 user nova-compute[73158]: </cpu>
Aug 17 10:07:22 user nova-compute[73158]:  {{(pid=73158) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Updated inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Updating resource provider 6683a228-d116-40aa-bd44-73677ce911ae generation from 0 to 1 during operation: update_inventory {{(pid=73158) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Updating resource provider 6683a228-d116-40aa-bd44-73677ce911ae generation from 1 to 2 during operation: update_traits {{(pid=73158) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.service [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Creating RPC server for service compute {{(pid=73158) start /opt/stack/nova/nova/service.py:182}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.service [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Join ServiceGroup membership for this service compute {{(pid=73158) start /opt/stack/nova/nova/service.py:199}}
Aug 17 10:07:22 user nova-compute[73158]: DEBUG nova.servicegroup.drivers.db [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73158) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:08:21 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:08:22 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:08:22 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:08:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=10177MB free_disk=25.14969253540039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:08:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:09:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:09:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=10118MB free_disk=25.19586944580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:09:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:09:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:09:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:09:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:09:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:09:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:10:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:10:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=10143MB free_disk=24.980125427246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:10:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:10:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:10:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:10:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:10:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:10:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:11:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=9410MB free_disk=25.003814697265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:11:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:11:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:11:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:11:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:23 user nova-compute[73158]: INFO nova.compute.claims [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Claim successful on node user
Aug 17 10:11:23 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:11:24 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:11:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:11:24 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Creating image(s)
Aug 17 10:11:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.075s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:24 user nova-compute[73158]: DEBUG nova.policy [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc72634020f043308464eca253691603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eece5be982b434daf80b44ec022192e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.part --force-share --output=json" returned: 0 in 0.212s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG nova.virt.images [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] 9b73e703-52fe-4fe4-ae2e-19e6c25bad78 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.part /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.part /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.converted" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.087s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:25 user nova-compute[73158]: INFO oslo.privsep.daemon [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpghjq1pq4/privsep.sock']
Aug 17 10:11:25 user sudo[82492]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpghjq1pq4/privsep.sock
Aug 17 10:11:25 user sudo[82492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 10:11:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:25 user nova-compute[73158]: INFO nova.compute.claims [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Claim successful on node user
Aug 17 10:11:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.290s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:26 user nova-compute[73158]: INFO nova.compute.claims [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Claim successful on node user
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:11:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:11:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Creating image(s)
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:11:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.policy [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc72634020f043308464eca253691603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eece5be982b434daf80b44ec022192e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:11:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Creating image(s)
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "/opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "/opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "/opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:26 user nova-compute[73158]: DEBUG nova.policy [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32ee6da717e0430d918febb4a6bdf303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c194aec258f5414b95bd1459ce8cdd58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:11:27 user sudo[82492]: pam_unix(sudo:session): session closed for user root
Aug 17 10:11:27 user nova-compute[73158]: INFO oslo.privsep.daemon [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Spawned new privsep daemon via rootwrap
Aug 17 10:11:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 10:11:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 10:11:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 10:11:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82495
Aug 17 10:11:27 user nova-compute[73158]: WARNING oslo_privsep.priv_context [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] privsep daemon already running
Aug 17 10:11:27 user nova-compute[73158]: WARNING oslo_privsep.priv_context [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] privsep daemon already running
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.207s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk 1073741824" returned: 0 in 0.046s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.240s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.207s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk 1073741824" returned: 0 in 0.041s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.485s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Cannot resize image /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'migration_context' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Ensure instance console log exists: /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Successfully created port: 9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk 1073741824" returned: 0 in 0.058s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Cannot resize image /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'migration_context' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Ensure instance console log exists: /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:11:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Cannot resize image /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lazy-loading 'migration_context' on Instance uuid e86f76e1-8c60-48df-97a4-83e356392908 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Ensure instance console log exists: /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:29 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Successfully created port: 507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:30 user nova-compute[73158]: INFO nova.compute.claims [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Claim successful on node user
Aug 17 10:11:30 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Successfully created port: 043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:30 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.network.neutron [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:11:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:11:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Creating image(s)
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "/opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "/opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "/opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.policy [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6db6c1120b74ffbb1bf354c509d27ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44597afe7d404702983ba1555116e936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.162s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk 1073741824" returned: 0 in 0.041s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.167s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Cannot resize image /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'migration_context' on Instance uuid f59460b3-cc6b-49db-b4d7-a86e2006de30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Ensure instance console log exists: /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:32 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Successfully updated port: 9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:11:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:32 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.compute.manager [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-changed-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.compute.manager [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Refreshing instance network info cache due to event network-changed-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Successfully updated port: 043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "refresh_cache-e86f76e1-8c60-48df-97a4-83e356392908" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquired lock "refresh_cache-e86f76e1-8c60-48df-97a4-83e356392908" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Successfully updated port: 507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:33 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-changed-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Refreshing instance network info cache due to event network-changed-043c9a6e-f1db-47f2-992b-7f4ae6954413. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] Acquiring lock "refresh_cache-e86f76e1-8c60-48df-97a4-83e356392908" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance network_info: |[{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.neutron [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Refreshing network info cache for port 9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Start _get_guest_xml network_info=[{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:11:34 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:34 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-396406171',display_name='tempest-ServerRescueNegativeTestJSON-server-396406171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-396406171',id=1,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-z5t0kqwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:24Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=ca69a434-ae39-4400-a07f-b49c41f99e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'pci_devices' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:11:34 user nova-compute[73158]:   <uuid>ca69a434-ae39-4400-a07f-b49c41f99e84</uuid>
Aug 17 10:11:34 user nova-compute[73158]:   <name>instance-00000001</name>
Aug 17 10:11:34 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:11:34 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:11:34 user nova-compute[73158]:   <metadata>
Aug 17 10:11:34 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:11:34 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:11:34 user nova-compute[73158]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-396406171</nova:name>
Aug 17 10:11:34 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:11:34</nova:creationTime>
Aug 17 10:11:34 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:11:34 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:11:34 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:11:34 user nova-compute[73158]:       <nova:owner>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:user uuid="fc72634020f043308464eca253691603">tempest-ServerRescueNegativeTestJSON-1859456269-project-member</nova:user>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:project uuid="0eece5be982b434daf80b44ec022192e">tempest-ServerRescueNegativeTestJSON-1859456269</nova:project>
Aug 17 10:11:34 user nova-compute[73158]:       </nova:owner>
Aug 17 10:11:34 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:11:34 user nova-compute[73158]:       <nova:ports>
Aug 17 10:11:34 user nova-compute[73158]:         <nova:port uuid="9bd6daa1-d3d3-4ce7-99c4-c8f80474e061">
Aug 17 10:11:34 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 10:11:34 user nova-compute[73158]:         </nova:port>
Aug 17 10:11:34 user nova-compute[73158]:       </nova:ports>
Aug 17 10:11:34 user nova-compute[73158]:     </nova:instance>
Aug 17 10:11:34 user nova-compute[73158]:   </metadata>
Aug 17 10:11:34 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:11:34 user nova-compute[73158]:     <system>
Aug 17 10:11:34 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:11:34 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:11:34 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:11:34 user nova-compute[73158]:       <entry name="serial">ca69a434-ae39-4400-a07f-b49c41f99e84</entry>
Aug 17 10:11:34 user nova-compute[73158]:       <entry name="uuid">ca69a434-ae39-4400-a07f-b49c41f99e84</entry>
Aug 17 10:11:34 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:11:34 user nova-compute[73158]:     </system>
Aug 17 10:11:34 user nova-compute[73158]:   </sysinfo>
Aug 17 10:11:34 user nova-compute[73158]:   <os>
Aug 17 10:11:34 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:11:34 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:11:34 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:11:34 user nova-compute[73158]:   </os>
Aug 17 10:11:34 user nova-compute[73158]:   <features>
Aug 17 10:11:34 user nova-compute[73158]:     <acpi/>
Aug 17 10:11:34 user nova-compute[73158]:     <apic/>
Aug 17 10:11:34 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:11:34 user nova-compute[73158]:   </features>
Aug 17 10:11:34 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:11:34 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:11:34 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:11:34 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:11:34 user nova-compute[73158]:   </clock>
Aug 17 10:11:34 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:11:34 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:11:34 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:11:34 user nova-compute[73158]:   </cpu>
Aug 17 10:11:34 user nova-compute[73158]:   <devices>
Aug 17 10:11:34 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:11:34 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:11:34 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk"/>
Aug 17 10:11:34 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:11:34 user nova-compute[73158]:     </disk>
Aug 17 10:11:34 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:11:34 user nova-compute[73158]:       <mac address="fa:16:3e:3a:d0:81"/>
Aug 17 10:11:34 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:34 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:11:34 user nova-compute[73158]:       <target dev="tap9bd6daa1-d3"/>
Aug 17 10:11:34 user nova-compute[73158]:     </interface>
Aug 17 10:11:34 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:11:34 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/console.log" append="off"/>
Aug 17 10:11:34 user nova-compute[73158]:     </serial>
Aug 17 10:11:34 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:11:34 user nova-compute[73158]:     <video>
Aug 17 10:11:34 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:34 user nova-compute[73158]:     </video>
Aug 17 10:11:34 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:11:34 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:11:34 user nova-compute[73158]:     </rng>
Aug 17 10:11:34 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:11:34 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:11:34 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:11:34 user nova-compute[73158]:     </memballoon>
Aug 17 10:11:34 user nova-compute[73158]:   </devices>
Aug 17 10:11:34 user nova-compute[73158]: </domain>
Aug 17 10:11:34 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-396406171',display_name='tempest-ServerRescueNegativeTestJSON-server-396406171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-396406171',id=1,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-z5t0kqwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:24Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=ca69a434-ae39-4400-a07f-b49c41f99e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG os_vif [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Created schema index Interface.name {{(pid=73158) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Created schema index Port.name {{(pid=73158) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Created schema index Bridge.name {{(pid=73158) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [POLLOUT] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:11:34 user nova-compute[73158]: DEBUG nova.network.neutron [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Successfully created port: 109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:11:35 user nova-compute[73158]: INFO oslo.privsep.daemon [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmph_vcm3oa/privsep.sock']
Aug 17 10:11:35 user sudo[82568]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmph_vcm3oa/privsep.sock
Aug 17 10:11:35 user sudo[82568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.compute.manager [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-changed-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.compute.manager [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Refreshing instance network info cache due to event network-changed-507dedf7-8751-47a4-be6a-8e1cab4bd4da. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] Acquiring lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Updating instance_info_cache with network_info: [{"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Releasing lock "refresh_cache-e86f76e1-8c60-48df-97a4-83e356392908" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Instance network_info: |[{"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] Acquired lock "refresh_cache-e86f76e1-8c60-48df-97a4-83e356392908" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.network.neutron [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Refreshing network info cache for port 043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Start _get_guest_xml network_info=[{"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:11:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-801032636',display_name='tempest-DeleteServersTestJSON-server-801032636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-801032636',id=3,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c194aec258f5414b95bd1459ce8cdd58',ramdisk_id='',reservation_id='r-28m90t50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-264240806',owner_user_name='tempest-DeleteServersTestJSON-264240806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:27Z,user_data=None,user_id='32ee6da717e0430d918febb4a6bdf303',uuid=e86f76e1-8c60-48df-97a4-83e356392908,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Converting VIF {"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lazy-loading 'pci_devices' on Instance uuid e86f76e1-8c60-48df-97a4-83e356392908 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:11:35 user nova-compute[73158]:   <uuid>e86f76e1-8c60-48df-97a4-83e356392908</uuid>
Aug 17 10:11:35 user nova-compute[73158]:   <name>instance-00000003</name>
Aug 17 10:11:35 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:11:35 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:11:35 user nova-compute[73158]:   <metadata>
Aug 17 10:11:35 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:11:35 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:11:35 user nova-compute[73158]:       <nova:name>tempest-DeleteServersTestJSON-server-801032636</nova:name>
Aug 17 10:11:35 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:11:35</nova:creationTime>
Aug 17 10:11:35 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:11:35 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:11:35 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:11:35 user nova-compute[73158]:       <nova:owner>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:user uuid="32ee6da717e0430d918febb4a6bdf303">tempest-DeleteServersTestJSON-264240806-project-member</nova:user>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:project uuid="c194aec258f5414b95bd1459ce8cdd58">tempest-DeleteServersTestJSON-264240806</nova:project>
Aug 17 10:11:35 user nova-compute[73158]:       </nova:owner>
Aug 17 10:11:35 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:11:35 user nova-compute[73158]:       <nova:ports>
Aug 17 10:11:35 user nova-compute[73158]:         <nova:port uuid="043c9a6e-f1db-47f2-992b-7f4ae6954413">
Aug 17 10:11:35 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 10:11:35 user nova-compute[73158]:         </nova:port>
Aug 17 10:11:35 user nova-compute[73158]:       </nova:ports>
Aug 17 10:11:35 user nova-compute[73158]:     </nova:instance>
Aug 17 10:11:35 user nova-compute[73158]:   </metadata>
Aug 17 10:11:35 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:11:35 user nova-compute[73158]:     <system>
Aug 17 10:11:35 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:11:35 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:11:35 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:11:35 user nova-compute[73158]:       <entry name="serial">e86f76e1-8c60-48df-97a4-83e356392908</entry>
Aug 17 10:11:35 user nova-compute[73158]:       <entry name="uuid">e86f76e1-8c60-48df-97a4-83e356392908</entry>
Aug 17 10:11:35 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:11:35 user nova-compute[73158]:     </system>
Aug 17 10:11:35 user nova-compute[73158]:   </sysinfo>
Aug 17 10:11:35 user nova-compute[73158]:   <os>
Aug 17 10:11:35 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:11:35 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:11:35 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:11:35 user nova-compute[73158]:   </os>
Aug 17 10:11:35 user nova-compute[73158]:   <features>
Aug 17 10:11:35 user nova-compute[73158]:     <acpi/>
Aug 17 10:11:35 user nova-compute[73158]:     <apic/>
Aug 17 10:11:35 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:11:35 user nova-compute[73158]:   </features>
Aug 17 10:11:35 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:11:35 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:11:35 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:11:35 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:11:35 user nova-compute[73158]:   </clock>
Aug 17 10:11:35 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:11:35 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:11:35 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:11:35 user nova-compute[73158]:   </cpu>
Aug 17 10:11:35 user nova-compute[73158]:   <devices>
Aug 17 10:11:35 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:11:35 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:11:35 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk"/>
Aug 17 10:11:35 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:11:35 user nova-compute[73158]:     </disk>
Aug 17 10:11:35 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:11:35 user nova-compute[73158]:       <mac address="fa:16:3e:4e:f2:b4"/>
Aug 17 10:11:35 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:35 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:11:35 user nova-compute[73158]:       <target dev="tap043c9a6e-f1"/>
Aug 17 10:11:35 user nova-compute[73158]:     </interface>
Aug 17 10:11:35 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:11:35 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/console.log" append="off"/>
Aug 17 10:11:35 user nova-compute[73158]:     </serial>
Aug 17 10:11:35 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:11:35 user nova-compute[73158]:     <video>
Aug 17 10:11:35 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:35 user nova-compute[73158]:     </video>
Aug 17 10:11:35 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:11:35 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:11:35 user nova-compute[73158]:     </rng>
Aug 17 10:11:35 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:11:35 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:11:35 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:11:35 user nova-compute[73158]:     </memballoon>
Aug 17 10:11:35 user nova-compute[73158]:   </devices>
Aug 17 10:11:35 user nova-compute[73158]: </domain>
Aug 17 10:11:35 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-801032636',display_name='tempest-DeleteServersTestJSON-server-801032636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-801032636',id=3,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c194aec258f5414b95bd1459ce8cdd58',ramdisk_id='',reservation_id='r-28m90t50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-264240806',owner_user_name='tempest-DeleteServersTestJSON-264240806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:27Z,user_data=None,user_id='32ee6da717e0430d918febb4a6bdf303',uuid=e86f76e1-8c60-48df-97a4-83e356392908,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Converting VIF {"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG os_vif [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance network_info: |[{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] Acquired lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.network.neutron [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Refreshing network info cache for port 507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Start _get_guest_xml network_info=[{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:11:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-776375975',display_name='tempest-ServerRescueNegativeTestJSON-server-776375975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-776375975',id=2,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-y6lb094v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:26Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=6450f74c-709c-47b9-9d6a-74aa81de118f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'pci_devices' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:11:36 user nova-compute[73158]:   <uuid>6450f74c-709c-47b9-9d6a-74aa81de118f</uuid>
Aug 17 10:11:36 user nova-compute[73158]:   <name>instance-00000002</name>
Aug 17 10:11:36 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:11:36 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:11:36 user nova-compute[73158]:   <metadata>
Aug 17 10:11:36 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:11:36 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:11:36 user nova-compute[73158]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-776375975</nova:name>
Aug 17 10:11:36 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:11:36</nova:creationTime>
Aug 17 10:11:36 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:11:36 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:11:36 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:11:36 user nova-compute[73158]:       <nova:owner>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:user uuid="fc72634020f043308464eca253691603">tempest-ServerRescueNegativeTestJSON-1859456269-project-member</nova:user>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:project uuid="0eece5be982b434daf80b44ec022192e">tempest-ServerRescueNegativeTestJSON-1859456269</nova:project>
Aug 17 10:11:36 user nova-compute[73158]:       </nova:owner>
Aug 17 10:11:36 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:11:36 user nova-compute[73158]:       <nova:ports>
Aug 17 10:11:36 user nova-compute[73158]:         <nova:port uuid="507dedf7-8751-47a4-be6a-8e1cab4bd4da">
Aug 17 10:11:36 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:11:36 user nova-compute[73158]:         </nova:port>
Aug 17 10:11:36 user nova-compute[73158]:       </nova:ports>
Aug 17 10:11:36 user nova-compute[73158]:     </nova:instance>
Aug 17 10:11:36 user nova-compute[73158]:   </metadata>
Aug 17 10:11:36 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:11:36 user nova-compute[73158]:     <system>
Aug 17 10:11:36 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:11:36 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:11:36 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:11:36 user nova-compute[73158]:       <entry name="serial">6450f74c-709c-47b9-9d6a-74aa81de118f</entry>
Aug 17 10:11:36 user nova-compute[73158]:       <entry name="uuid">6450f74c-709c-47b9-9d6a-74aa81de118f</entry>
Aug 17 10:11:36 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:11:36 user nova-compute[73158]:     </system>
Aug 17 10:11:36 user nova-compute[73158]:   </sysinfo>
Aug 17 10:11:36 user nova-compute[73158]:   <os>
Aug 17 10:11:36 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:11:36 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:11:36 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:11:36 user nova-compute[73158]:   </os>
Aug 17 10:11:36 user nova-compute[73158]:   <features>
Aug 17 10:11:36 user nova-compute[73158]:     <acpi/>
Aug 17 10:11:36 user nova-compute[73158]:     <apic/>
Aug 17 10:11:36 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:11:36 user nova-compute[73158]:   </features>
Aug 17 10:11:36 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:11:36 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:11:36 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:11:36 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:11:36 user nova-compute[73158]:   </clock>
Aug 17 10:11:36 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:11:36 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:11:36 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:11:36 user nova-compute[73158]:   </cpu>
Aug 17 10:11:36 user nova-compute[73158]:   <devices>
Aug 17 10:11:36 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:11:36 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:11:36 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk"/>
Aug 17 10:11:36 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:11:36 user nova-compute[73158]:     </disk>
Aug 17 10:11:36 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:11:36 user nova-compute[73158]:       <mac address="fa:16:3e:bd:d8:62"/>
Aug 17 10:11:36 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:36 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:11:36 user nova-compute[73158]:       <target dev="tap507dedf7-87"/>
Aug 17 10:11:36 user nova-compute[73158]:     </interface>
Aug 17 10:11:36 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:11:36 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/console.log" append="off"/>
Aug 17 10:11:36 user nova-compute[73158]:     </serial>
Aug 17 10:11:36 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:11:36 user nova-compute[73158]:     <video>
Aug 17 10:11:36 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:36 user nova-compute[73158]:     </video>
Aug 17 10:11:36 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:11:36 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:11:36 user nova-compute[73158]:     </rng>
Aug 17 10:11:36 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:11:36 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:11:36 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:11:36 user nova-compute[73158]:     </memballoon>
Aug 17 10:11:36 user nova-compute[73158]:   </devices>
Aug 17 10:11:36 user nova-compute[73158]: </domain>
Aug 17 10:11:36 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-776375975',display_name='tempest-ServerRescueNegativeTestJSON-server-776375975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-776375975',id=2,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-y6lb094v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:26Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=6450f74c-709c-47b9-9d6a-74aa81de118f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG os_vif [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:11:36 user sudo[82568]: pam_unix(sudo:session): session closed for user root
Aug 17 10:11:36 user nova-compute[73158]: INFO oslo.privsep.daemon [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Spawned new privsep daemon via rootwrap
Aug 17 10:11:36 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 10:11:36 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 10:11:36 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 10:11:36 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82596
Aug 17 10:11:36 user nova-compute[73158]: WARNING oslo_privsep.priv_context [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] privsep daemon already running
Aug 17 10:11:36 user nova-compute[73158]: WARNING oslo_privsep.priv_context [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] privsep daemon already running
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.network.neutron [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Updated VIF entry in instance network info cache for port 043c9a6e-f1db-47f2-992b-7f4ae6954413. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.network.neutron [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Updating instance_info_cache with network_info: [{"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c7e425f9-0d3f-455f-ad38-75518f99ccdd req-687c70ba-94d5-44bd-9a1c-78b1436f754f service nova] Releasing lock "refresh_cache-e86f76e1-8c60-48df-97a4-83e356392908" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap043c9a6e-f1, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap043c9a6e-f1, col_values=(('external_ids', {'iface-id': '043c9a6e-f1db-47f2-992b-7f4ae6954413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:f2:b4', 'vm-uuid': 'e86f76e1-8c60-48df-97a4-83e356392908'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap507dedf7-87, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap507dedf7-87, col_values=(('external_ids', {'iface-id': '507dedf7-8751-47a4-be6a-8e1cab4bd4da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:d8:62', 'vm-uuid': '6450f74c-709c-47b9-9d6a-74aa81de118f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:37 user nova-compute[73158]: INFO os_vif [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1')
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: INFO os_vif [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87')
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bd6daa1-d3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bd6daa1-d3, col_values=(('external_ids', {'iface-id': '9bd6daa1-d3d3-4ce7-99c4-c8f80474e061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:d0:81', 'vm-uuid': 'ca69a434-ae39-4400-a07f-b49c41f99e84'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:37 user nova-compute[73158]: INFO os_vif [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3')
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:bd:d8:62, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] No VIF found with MAC fa:16:3e:4e:f2:b4, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:3a:d0:81, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.network.neutron [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updated VIF entry in instance network info cache for port 9bd6daa1-d3d3-4ce7-99c4-c8f80474e061. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG nova.network.neutron [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-66618237-246f-4cd9-8c46-6267c1b7c2f3 req-1fc90f8f-8b92-4bf6-b450-e1db030d1b39 service nova] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Successfully updated port: 109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-changed-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Refreshing instance network info cache due to event network-changed-109973c2-4d29-48ed-8141-e45dc9ec66f7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updated VIF entry in instance network info cache for port 507dedf7-8751-47a4-be6a-8e1cab4bd4da. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1426266d-6613-4471-b4c2-0c9e4d540384 req-b824627b-14ff-49f1-8d62-accaf37b5bbb service nova] Releasing lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Instance network_info: |[{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Refreshing network info cache for port 109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Start _get_guest_xml network_info=[{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:11:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1508890590',display_name='tempest-ServerActionsTestOtherA-server-1508890590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1508890590',id=4,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-gr6dlspj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=f59460b3-cc6b-49db-b4d7-a86e2006de30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_devices' on Instance uuid f59460b3-cc6b-49db-b4d7-a86e2006de30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:11:39 user nova-compute[73158]:   <uuid>f59460b3-cc6b-49db-b4d7-a86e2006de30</uuid>
Aug 17 10:11:39 user nova-compute[73158]:   <name>instance-00000004</name>
Aug 17 10:11:39 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:11:39 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:11:39 user nova-compute[73158]:   <metadata>
Aug 17 10:11:39 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:11:39 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:11:39 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherA-server-1508890590</nova:name>
Aug 17 10:11:39 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:11:39</nova:creationTime>
Aug 17 10:11:39 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:11:39 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:11:39 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:11:39 user nova-compute[73158]:       <nova:owner>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:user uuid="a6db6c1120b74ffbb1bf354c509d27ec">tempest-ServerActionsTestOtherA-1163059526-project-member</nova:user>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:project uuid="44597afe7d404702983ba1555116e936">tempest-ServerActionsTestOtherA-1163059526</nova:project>
Aug 17 10:11:39 user nova-compute[73158]:       </nova:owner>
Aug 17 10:11:39 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:11:39 user nova-compute[73158]:       <nova:ports>
Aug 17 10:11:39 user nova-compute[73158]:         <nova:port uuid="109973c2-4d29-48ed-8141-e45dc9ec66f7">
Aug 17 10:11:39 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 10:11:39 user nova-compute[73158]:         </nova:port>
Aug 17 10:11:39 user nova-compute[73158]:       </nova:ports>
Aug 17 10:11:39 user nova-compute[73158]:     </nova:instance>
Aug 17 10:11:39 user nova-compute[73158]:   </metadata>
Aug 17 10:11:39 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:11:39 user nova-compute[73158]:     <system>
Aug 17 10:11:39 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:11:39 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:11:39 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:11:39 user nova-compute[73158]:       <entry name="serial">f59460b3-cc6b-49db-b4d7-a86e2006de30</entry>
Aug 17 10:11:39 user nova-compute[73158]:       <entry name="uuid">f59460b3-cc6b-49db-b4d7-a86e2006de30</entry>
Aug 17 10:11:39 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:11:39 user nova-compute[73158]:     </system>
Aug 17 10:11:39 user nova-compute[73158]:   </sysinfo>
Aug 17 10:11:39 user nova-compute[73158]:   <os>
Aug 17 10:11:39 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:11:39 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:11:39 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:11:39 user nova-compute[73158]:   </os>
Aug 17 10:11:39 user nova-compute[73158]:   <features>
Aug 17 10:11:39 user nova-compute[73158]:     <acpi/>
Aug 17 10:11:39 user nova-compute[73158]:     <apic/>
Aug 17 10:11:39 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:11:39 user nova-compute[73158]:   </features>
Aug 17 10:11:39 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:11:39 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:11:39 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:11:39 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:11:39 user nova-compute[73158]:   </clock>
Aug 17 10:11:39 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:11:39 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:11:39 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:11:39 user nova-compute[73158]:   </cpu>
Aug 17 10:11:39 user nova-compute[73158]:   <devices>
Aug 17 10:11:39 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:11:39 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:11:39 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk"/>
Aug 17 10:11:39 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:11:39 user nova-compute[73158]:     </disk>
Aug 17 10:11:39 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:11:39 user nova-compute[73158]:       <mac address="fa:16:3e:b3:f9:a0"/>
Aug 17 10:11:39 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:39 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:11:39 user nova-compute[73158]:       <target dev="tap109973c2-4d"/>
Aug 17 10:11:39 user nova-compute[73158]:     </interface>
Aug 17 10:11:39 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:11:39 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/console.log" append="off"/>
Aug 17 10:11:39 user nova-compute[73158]:     </serial>
Aug 17 10:11:39 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:11:39 user nova-compute[73158]:     <video>
Aug 17 10:11:39 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:11:39 user nova-compute[73158]:     </video>
Aug 17 10:11:39 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:11:39 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:11:39 user nova-compute[73158]:     </rng>
Aug 17 10:11:39 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:11:39 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:11:39 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:11:39 user nova-compute[73158]:     </memballoon>
Aug 17 10:11:39 user nova-compute[73158]:   </devices>
Aug 17 10:11:39 user nova-compute[73158]: </domain>
Aug 17 10:11:39 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1508890590',display_name='tempest-ServerActionsTestOtherA-server-1508890590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1508890590',id=4,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-gr6dlspj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=f59460b3-cc6b-49db-b4d7-a86e2006de30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG os_vif [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap109973c2-4d, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap109973c2-4d, col_values=(('external_ids', {'iface-id': '109973c2-4d29-48ed-8141-e45dc9ec66f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:f9:a0', 'vm-uuid': 'f59460b3-cc6b-49db-b4d7-a86e2006de30'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:11:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:39 user nova-compute[73158]: INFO os_vif [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d')
Aug 17 10:11:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:11:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No VIF found with MAC fa:16:3e:b3:f9:a0, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:11:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG nova.network.neutron [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated VIF entry in instance network info cache for port 109973c2-4d29-48ed-8141-e45dc9ec66f7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG nova.network.neutron [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-79d363b0-daf8-4acb-b07a-6dbf4331661d req-eb0c93c2-f635-41dd-86aa-8618fa5cf964 service nova] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.3892741, ca69a434-ae39-4400-a07f-b49c41f99e84 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Resumed (Lifecycle Event)
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance spawned successfully.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Instance spawned successfully.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.4020908, ca69a434-ae39-4400-a07f-b49c41f99e84 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Started (Lifecycle Event)
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Took 21.31 seconds to spawn the instance on the hypervisor.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance spawned successfully.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.4151282, e86f76e1-8c60-48df-97a4-83e356392908 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] VM Resumed (Lifecycle Event)
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Took 19.08 seconds to spawn the instance on the hypervisor.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Instance spawned successfully.
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Took 22.57 seconds to build instance.
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Took 20.24 seconds to build instance.
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.427839, e86f76e1-8c60-48df-97a4-83e356392908 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] VM Started (Lifecycle Event)
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8b132008-352c-4c6a-bace-e4fd974e3941 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.832s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Took 19.68 seconds to spawn the instance on the hypervisor.
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fb7-16c7-40af-a691-9450827de4c1 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.506s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Took 14.91 seconds to spawn the instance on the hypervisor.
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.7117488, 6450f74c-709c-47b9-9d6a-74aa81de118f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] VM Resumed (Lifecycle Event)
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Took 20.64 seconds to build instance.
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.712175, 6450f74c-709c-47b9-9d6a-74aa81de118f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] VM Started (Lifecycle Event)
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2a5ca331-0df9-4db0-8a7d-0295c50d29f8 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.875s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Took 15.72 seconds to build instance.
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5d5d8e-3b4e-4b76-bcba-ee8c5787d8a8 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.818s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.8906114, f59460b3-cc6b-49db-b4d7-a86e2006de30 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] VM Resumed (Lifecycle Event)
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267105.89485, f59460b3-cc6b-49db-b4d7-a86e2006de30 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:11:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] VM Started (Lifecycle Event)
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-c926224e-a7b1-45e8-9321-600d4e806967 req-5d1a9c50-2497-4440-8b7d-963f6e129e70 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c926224e-a7b1-45e8-9321-600d4e806967 req-5d1a9c50-2497-4440-8b7d-963f6e129e70 service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c926224e-a7b1-45e8-9321-600d4e806967 req-5d1a9c50-2497-4440-8b7d-963f6e129e70 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c926224e-a7b1-45e8-9321-600d4e806967 req-5d1a9c50-2497-4440-8b7d-963f6e129e70 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-c926224e-a7b1-45e8-9321-600d4e806967 req-5d1a9c50-2497-4440-8b7d-963f6e129e70 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:11:46 user nova-compute[73158]: WARNING nova.compute.manager [req-c926224e-a7b1-45e8-9321-600d4e806967 req-5d1a9c50-2497-4440-8b7d-963f6e129e70 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state active and task_state None.
Aug 17 10:11:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-620bb6e5-2878-408b-a0eb-955a90735c0f req-3b4ed8b1-3ab2-4eba-a646-ab37d7789ad8 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-620bb6e5-2878-408b-a0eb-955a90735c0f req-3b4ed8b1-3ab2-4eba-a646-ab37d7789ad8 service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-620bb6e5-2878-408b-a0eb-955a90735c0f req-3b4ed8b1-3ab2-4eba-a646-ab37d7789ad8 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-620bb6e5-2878-408b-a0eb-955a90735c0f req-3b4ed8b1-3ab2-4eba-a646-ab37d7789ad8 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-620bb6e5-2878-408b-a0eb-955a90735c0f req-3b4ed8b1-3ab2-4eba-a646-ab37d7789ad8 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:11:49 user nova-compute[73158]: WARNING nova.compute.manager [req-620bb6e5-2878-408b-a0eb-955a90735c0f req-3b4ed8b1-3ab2-4eba-a646-ab37d7789ad8 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state active and task_state None.
Aug 17 10:11:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:56 user nova-compute[73158]: INFO nova.compute.claims [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Claim successful on node user
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:11:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 10:11:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG nova.policy [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9c1836963bd4a2a8af1f5feed7eced3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4ba6e407134d289cdc98e0ff892230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:11:57 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Creating image(s)
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "/opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "/opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "f7770cec0d75cfce4b66e053c5833b46404a9b2f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "f7770cec0d75cfce4b66e053c5833b46404a9b2f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.part --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG nova.virt.images [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] c312ade9-af9a-4899-a2ad-c684c29aee7e was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:11:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.part /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.018s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:58 user nova-compute[73158]: INFO nova.compute.claims [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Claim successful on node user
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.part /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.converted" returned: 0 in 0.301s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Successfully created port: 401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f.converted --force-share --output=json" returned: 0 in 0.300s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "f7770cec0d75cfce4b66e053c5833b46404a9b2f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.418s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f --force-share --output=json" returned: 0 in 0.309s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "f7770cec0d75cfce4b66e053c5833b46404a9b2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "f7770cec0d75cfce4b66e053c5833b46404a9b2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f --force-share --output=json" returned: 0 in 0.199s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f,backing_fmt=raw /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.004s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f,backing_fmt=raw /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk 1073741824" returned: 0 in 0.081s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.547s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "f7770cec0d75cfce4b66e053c5833b46404a9b2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:11:59 user nova-compute[73158]: INFO nova.compute.claims [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Claim successful on node user
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:11:59 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f --force-share --output=json" returned: 0 in 0.323s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:11:59 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Creating image(s)
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "/opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "/opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.policy [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67894181ef514eb48b67fafdacebfbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c4fe0cb9440eb9f53959fb55ee44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Cannot resize image /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lazy-loading 'migration_context' on Instance uuid 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Ensure instance console log exists: /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.244s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:11:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk 1073741824" returned: 0 in 0.057s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.100s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:12:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.289s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:12:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Creating image(s)
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "/opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "/opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Cannot resize image /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lazy-loading 'migration_context' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.policy [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8cdcc95e0854d68a15db4d7e3d998e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3a5e2269964313aa7a3a3d4d2e604f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Successfully updated port: 401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquired lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-changed-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Refreshing instance network info cache due to event network-changed-401613bc-ae59-486b-9aa8-ef866b1dc8d7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] Acquiring lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.253s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk 1073741824" returned: 0 in 0.065s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.266s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updating instance_info_cache with network_info: [{"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Cannot resize image /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'migration_context' on Instance uuid c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Ensure instance console log exists: /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Releasing lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Instance network_info: |[{"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] Acquired lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Refreshing network info cache for port 401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Start _get_guest_xml network_info=[{"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:11:47Z,direct_url=<?>,disk_format='qcow2',id=c312ade9-af9a-4899-a2ad-c684c29aee7e,min_disk=0,min_ram=0,name='',owner='7865e09c2de04253916710762d481c3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:11:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'c312ade9-af9a-4899-a2ad-c684c29aee7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:12:01 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:01 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:11:47Z,direct_url=<?>,disk_format='qcow2',id=c312ade9-af9a-4899-a2ad-c684c29aee7e,min_disk=0,min_ram=0,name='',owner='7865e09c2de04253916710762d481c3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:11:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1953341085',display_name='tempest-AttachSCSIVolumeTestJSON-server-1953341085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1953341085',id=5,image_ref='c312ade9-af9a-4899-a2ad-c684c29aee7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg3J3p/ZKa9m7MJdUHWBqq/Yqee3a/EPSyTvvoU3b+6Dti39g/X6Dac435A7BKRFdbJ03RMBFxtUYVR4xS1E5ukCwPSE1HBID4ETNpKBwXiogzg6E3Gz8yuqcDN4bDWGw==',key_name='tempest-keypair-1884051300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb4ba6e407134d289cdc98e0ff892230',ramdisk_id='',reservation_id='r-kkntuat6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c312ade9-af9a-4899-a2ad-c684c29aee7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1442195416',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1442195416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9c1836963bd4a2a8af1f5feed7eced3',uuid=6e23eb52-c52f-4ae4-912c-f7d517ba78a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Converting VIF {"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:12:01 user nova-compute[73158]:   <uuid>6e23eb52-c52f-4ae4-912c-f7d517ba78a4</uuid>
Aug 17 10:12:01 user nova-compute[73158]:   <name>instance-00000005</name>
Aug 17 10:12:01 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:12:01 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:12:01 user nova-compute[73158]:   <metadata>
Aug 17 10:12:01 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:12:01 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:12:01 user nova-compute[73158]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1953341085</nova:name>
Aug 17 10:12:01 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:12:01</nova:creationTime>
Aug 17 10:12:01 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:12:01 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:12:01 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:12:01 user nova-compute[73158]:       <nova:owner>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:user uuid="e9c1836963bd4a2a8af1f5feed7eced3">tempest-AttachSCSIVolumeTestJSON-1442195416-project-member</nova:user>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:project uuid="fb4ba6e407134d289cdc98e0ff892230">tempest-AttachSCSIVolumeTestJSON-1442195416</nova:project>
Aug 17 10:12:01 user nova-compute[73158]:       </nova:owner>
Aug 17 10:12:01 user nova-compute[73158]:       <nova:root type="image" uuid="c312ade9-af9a-4899-a2ad-c684c29aee7e"/>
Aug 17 10:12:01 user nova-compute[73158]:       <nova:ports>
Aug 17 10:12:01 user nova-compute[73158]:         <nova:port uuid="401613bc-ae59-486b-9aa8-ef866b1dc8d7">
Aug 17 10:12:01 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:12:01 user nova-compute[73158]:         </nova:port>
Aug 17 10:12:01 user nova-compute[73158]:       </nova:ports>
Aug 17 10:12:01 user nova-compute[73158]:     </nova:instance>
Aug 17 10:12:01 user nova-compute[73158]:   </metadata>
Aug 17 10:12:01 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:12:01 user nova-compute[73158]:     <system>
Aug 17 10:12:01 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:12:01 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:12:01 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:12:01 user nova-compute[73158]:       <entry name="serial">6e23eb52-c52f-4ae4-912c-f7d517ba78a4</entry>
Aug 17 10:12:01 user nova-compute[73158]:       <entry name="uuid">6e23eb52-c52f-4ae4-912c-f7d517ba78a4</entry>
Aug 17 10:12:01 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:12:01 user nova-compute[73158]:     </system>
Aug 17 10:12:01 user nova-compute[73158]:   </sysinfo>
Aug 17 10:12:01 user nova-compute[73158]:   <os>
Aug 17 10:12:01 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:12:01 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:12:01 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:12:01 user nova-compute[73158]:   </os>
Aug 17 10:12:01 user nova-compute[73158]:   <features>
Aug 17 10:12:01 user nova-compute[73158]:     <acpi/>
Aug 17 10:12:01 user nova-compute[73158]:     <apic/>
Aug 17 10:12:01 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:12:01 user nova-compute[73158]:   </features>
Aug 17 10:12:01 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:12:01 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:12:01 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:12:01 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:12:01 user nova-compute[73158]:   </clock>
Aug 17 10:12:01 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:12:01 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:12:01 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:12:01 user nova-compute[73158]:   </cpu>
Aug 17 10:12:01 user nova-compute[73158]:   <devices>
Aug 17 10:12:01 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:12:01 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:12:01 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk"/>
Aug 17 10:12:01 user nova-compute[73158]:       <target dev="sda" bus="scsi"/>
Aug 17 10:12:01 user nova-compute[73158]:       <address type="drive" controller="0" unit="0"/>
Aug 17 10:12:01 user nova-compute[73158]:     </disk>
Aug 17 10:12:01 user nova-compute[73158]:     <disk type="file" device="cdrom">
Aug 17 10:12:01 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 10:12:01 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.config"/>
Aug 17 10:12:01 user nova-compute[73158]:       <target dev="sdb" bus="scsi"/>
Aug 17 10:12:01 user nova-compute[73158]:       <address type="drive" controller="0" unit="1"/>
Aug 17 10:12:01 user nova-compute[73158]:     </disk>
Aug 17 10:12:01 user nova-compute[73158]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 10:12:01 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:12:01 user nova-compute[73158]:       <mac address="fa:16:3e:f3:9f:0a"/>
Aug 17 10:12:01 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:01 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:12:01 user nova-compute[73158]:       <target dev="tap401613bc-ae"/>
Aug 17 10:12:01 user nova-compute[73158]:     </interface>
Aug 17 10:12:01 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:12:01 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/console.log" append="off"/>
Aug 17 10:12:01 user nova-compute[73158]:     </serial>
Aug 17 10:12:01 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:12:01 user nova-compute[73158]:     <video>
Aug 17 10:12:01 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:01 user nova-compute[73158]:     </video>
Aug 17 10:12:01 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:12:01 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:12:01 user nova-compute[73158]:     </rng>
Aug 17 10:12:01 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:12:01 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:12:01 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:12:01 user nova-compute[73158]:     </memballoon>
Aug 17 10:12:01 user nova-compute[73158]:   </devices>
Aug 17 10:12:01 user nova-compute[73158]: </domain>
Aug 17 10:12:01 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1953341085',display_name='tempest-AttachSCSIVolumeTestJSON-server-1953341085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1953341085',id=5,image_ref='c312ade9-af9a-4899-a2ad-c684c29aee7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg3J3p/ZKa9m7MJdUHWBqq/Yqee3a/EPSyTvvoU3b+6Dti39g/X6Dac435A7BKRFdbJ03RMBFxtUYVR4xS1E5ukCwPSE1HBID4ETNpKBwXiogzg6E3Gz8yuqcDN4bDWGw==',key_name='tempest-keypair-1884051300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb4ba6e407134d289cdc98e0ff892230',ramdisk_id='',reservation_id='r-kkntuat6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c312ade9-af9a-4899-a2ad-c684c29aee7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1442195416',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1442195416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9c1836963bd4a2a8af1f5feed7eced3',uuid=6e23eb52-c52f-4ae4-912c-f7d517ba78a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Converting VIF {"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG os_vif [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap401613bc-ae, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap401613bc-ae, col_values=(('external_ids', {'iface-id': '401613bc-ae59-486b-9aa8-ef866b1dc8d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:9f:0a', 'vm-uuid': '6e23eb52-c52f-4ae4-912c-f7d517ba78a4'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:01 user nova-compute[73158]: INFO os_vif [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae')
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Successfully created port: 43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No BDM found with device name sda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:12:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No VIF found with MAC fa:16:3e:f3:9f:0a, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:12:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Using config drive
Aug 17 10:12:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Successfully created port: 6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Creating config drive at /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.config
Aug 17 10:12:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6vaxk57l {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updated VIF entry in instance network info cache for port 401613bc-ae59-486b-9aa8-ef866b1dc8d7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:12:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updating instance_info_cache with network_info: [{"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6vaxk57l" returned: 0 in 0.075s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7343dc03-babb-4274-8922-a4ad102413d7 req-5eecc5ab-c3c4-4f39-9994-5010401a1103 service nova] Releasing lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Successfully updated port: 43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquired lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Successfully updated port: 6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquired lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-changed-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Refreshing instance network info cache due to event network-changed-43982739-d0ed-4ec8-9576-31879af40e8a. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] Acquiring lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updating instance_info_cache with network_info: [{"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating instance_info_cache with network_info: [{"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Releasing lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Instance network_info: |[{"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] Acquired lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Refreshing network info cache for port 43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Start _get_guest_xml network_info=[{"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Releasing lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Instance network_info: |[{"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Start _get_guest_xml network_info=[{"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:12:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:12:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1642266553',display_name='tempest-VolumesAssistedSnapshotsTest-server-1642266553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1642266553',id=6,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzHO1nuHo9Gu0sTJgsRlanhpH1L24rlfx+wLjffAAYaBGTLeP/n7hWV07O/IW3/0GztbaRU+QXlz3Je0hEyuyrXhA4C9VUFQ2g2yDPu6mvi4nMv6V7NxMwMNaA9aavlVw==',key_name='tempest-keypair-1288337486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8c4fe0cb9440eb9f53959fb55ee44a',ramdisk_id='',reservation_id='r-47jbzrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-547804155',owner_user_name='tempest-VolumesAssistedSnapshotsTest-547804155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67894181ef514eb48b67fafdacebfbbc',uuid=4fe0d193-0f59-449a-89d1-e9445cad5038,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Converting VIF {"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1731755005',display_name='tempest-VolumesAdminNegativeTest-server-1731755005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1731755005',id=7,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbKpon8Q2vw3LAN3SWPZV/UXKCYVS0/vEGGAwJLSYQptFTTqIjg1GxceK0fzUK/fZYNGUYUPyYVm4X4WfFWFtc8uL5h6IaXh4hF2U2uEP6ShyA/QZu6b3C8+1nQ6BACuw==',key_name='tempest-keypair-1794708543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3a5e2269964313aa7a3a3d4d2e604f',ramdisk_id='',reservation_id='r-yhjgv6nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1264923804',owner_user_name='tempest-VolumesAdminNegativeTest-1264923804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8cdcc95e0854d68a15db4d7e3d998e5',uuid=c3b24204-badc-4d40-9b96-5a8b07a49250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converting VIF {"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'pci_devices' on Instance uuid c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:12:05 user nova-compute[73158]:   <uuid>4fe0d193-0f59-449a-89d1-e9445cad5038</uuid>
Aug 17 10:12:05 user nova-compute[73158]:   <name>instance-00000006</name>
Aug 17 10:12:05 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:12:05 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:12:05 user nova-compute[73158]:   <metadata>
Aug 17 10:12:05 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:12:05 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1642266553</nova:name>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:12:04</nova:creationTime>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:12:05 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:12:05 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:owner>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:user uuid="67894181ef514eb48b67fafdacebfbbc">tempest-VolumesAssistedSnapshotsTest-547804155-project-member</nova:user>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:project uuid="4a8c4fe0cb9440eb9f53959fb55ee44a">tempest-VolumesAssistedSnapshotsTest-547804155</nova:project>
Aug 17 10:12:05 user nova-compute[73158]:       </nova:owner>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:ports>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:port uuid="43982739-d0ed-4ec8-9576-31879af40e8a">
Aug 17 10:12:05 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 10:12:05 user nova-compute[73158]:         </nova:port>
Aug 17 10:12:05 user nova-compute[73158]:       </nova:ports>
Aug 17 10:12:05 user nova-compute[73158]:     </nova:instance>
Aug 17 10:12:05 user nova-compute[73158]:   </metadata>
Aug 17 10:12:05 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:12:05 user nova-compute[73158]:     <system>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="serial">4fe0d193-0f59-449a-89d1-e9445cad5038</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="uuid">4fe0d193-0f59-449a-89d1-e9445cad5038</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:12:05 user nova-compute[73158]:     </system>
Aug 17 10:12:05 user nova-compute[73158]:   </sysinfo>
Aug 17 10:12:05 user nova-compute[73158]:   <os>
Aug 17 10:12:05 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:12:05 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:12:05 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:12:05 user nova-compute[73158]:   </os>
Aug 17 10:12:05 user nova-compute[73158]:   <features>
Aug 17 10:12:05 user nova-compute[73158]:     <acpi/>
Aug 17 10:12:05 user nova-compute[73158]:     <apic/>
Aug 17 10:12:05 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:12:05 user nova-compute[73158]:   </features>
Aug 17 10:12:05 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:12:05 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:12:05 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:12:05 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:12:05 user nova-compute[73158]:   </clock>
Aug 17 10:12:05 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:12:05 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:12:05 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:12:05 user nova-compute[73158]:   </cpu>
Aug 17 10:12:05 user nova-compute[73158]:   <devices>
Aug 17 10:12:05 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:12:05 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:12:05 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk"/>
Aug 17 10:12:05 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:12:05 user nova-compute[73158]:     </disk>
Aug 17 10:12:05 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:12:05 user nova-compute[73158]:       <mac address="fa:16:3e:3c:db:35"/>
Aug 17 10:12:05 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:05 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:12:05 user nova-compute[73158]:       <target dev="tap43982739-d0"/>
Aug 17 10:12:05 user nova-compute[73158]:     </interface>
Aug 17 10:12:05 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:12:05 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/console.log" append="off"/>
Aug 17 10:12:05 user nova-compute[73158]:     </serial>
Aug 17 10:12:05 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:12:05 user nova-compute[73158]:     <video>
Aug 17 10:12:05 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:05 user nova-compute[73158]:     </video>
Aug 17 10:12:05 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:12:05 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:12:05 user nova-compute[73158]:     </rng>
Aug 17 10:12:05 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:12:05 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:12:05 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:12:05 user nova-compute[73158]:     </memballoon>
Aug 17 10:12:05 user nova-compute[73158]:   </devices>
Aug 17 10:12:05 user nova-compute[73158]: </domain>
Aug 17 10:12:05 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1642266553',display_name='tempest-VolumesAssistedSnapshotsTest-server-1642266553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1642266553',id=6,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzHO1nuHo9Gu0sTJgsRlanhpH1L24rlfx+wLjffAAYaBGTLeP/n7hWV07O/IW3/0GztbaRU+QXlz3Je0hEyuyrXhA4C9VUFQ2g2yDPu6mvi4nMv6V7NxMwMNaA9aavlVw==',key_name='tempest-keypair-1288337486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8c4fe0cb9440eb9f53959fb55ee44a',ramdisk_id='',reservation_id='r-47jbzrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-547804155',owner_user_name='tempest-VolumesAssistedSnapshotsTest-547804155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67894181ef514eb48b67fafdacebfbbc',uuid=4fe0d193-0f59-449a-89d1-e9445cad5038,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Converting VIF {"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG os_vif [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43982739-d0, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43982739-d0, col_values=(('external_ids', {'iface-id': '43982739-d0ed-4ec8-9576-31879af40e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:db:35', 'vm-uuid': '4fe0d193-0f59-449a-89d1-e9445cad5038'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:12:05 user nova-compute[73158]:   <uuid>c3b24204-badc-4d40-9b96-5a8b07a49250</uuid>
Aug 17 10:12:05 user nova-compute[73158]:   <name>instance-00000007</name>
Aug 17 10:12:05 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:12:05 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:12:05 user nova-compute[73158]:   <metadata>
Aug 17 10:12:05 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:12:05 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1731755005</nova:name>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:12:04</nova:creationTime>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:12:05 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:12:05 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:owner>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:user uuid="a8cdcc95e0854d68a15db4d7e3d998e5">tempest-VolumesAdminNegativeTest-1264923804-project-member</nova:user>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:project uuid="cc3a5e2269964313aa7a3a3d4d2e604f">tempest-VolumesAdminNegativeTest-1264923804</nova:project>
Aug 17 10:12:05 user nova-compute[73158]:       </nova:owner>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:12:05 user nova-compute[73158]:       <nova:ports>
Aug 17 10:12:05 user nova-compute[73158]:         <nova:port uuid="6281f6ca-0a00-45f8-907c-1e228b9eccae">
Aug 17 10:12:05 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 10:12:05 user nova-compute[73158]:         </nova:port>
Aug 17 10:12:05 user nova-compute[73158]:       </nova:ports>
Aug 17 10:12:05 user nova-compute[73158]:     </nova:instance>
Aug 17 10:12:05 user nova-compute[73158]:   </metadata>
Aug 17 10:12:05 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:12:05 user nova-compute[73158]:     <system>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="serial">c3b24204-badc-4d40-9b96-5a8b07a49250</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="uuid">c3b24204-badc-4d40-9b96-5a8b07a49250</entry>
Aug 17 10:12:05 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:12:05 user nova-compute[73158]:     </system>
Aug 17 10:12:05 user nova-compute[73158]:   </sysinfo>
Aug 17 10:12:05 user nova-compute[73158]:   <os>
Aug 17 10:12:05 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:12:05 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:12:05 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:12:05 user nova-compute[73158]:   </os>
Aug 17 10:12:05 user nova-compute[73158]:   <features>
Aug 17 10:12:05 user nova-compute[73158]:     <acpi/>
Aug 17 10:12:05 user nova-compute[73158]:     <apic/>
Aug 17 10:12:05 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:12:05 user nova-compute[73158]:   </features>
Aug 17 10:12:05 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:12:05 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:12:05 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:12:05 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:12:05 user nova-compute[73158]:   </clock>
Aug 17 10:12:05 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:12:05 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:12:05 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:12:05 user nova-compute[73158]:   </cpu>
Aug 17 10:12:05 user nova-compute[73158]:   <devices>
Aug 17 10:12:05 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:12:05 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:12:05 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk"/>
Aug 17 10:12:05 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:12:05 user nova-compute[73158]:     </disk>
Aug 17 10:12:05 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:12:05 user nova-compute[73158]:       <mac address="fa:16:3e:f2:fc:29"/>
Aug 17 10:12:05 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:05 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:12:05 user nova-compute[73158]:       <target dev="tap6281f6ca-0a"/>
Aug 17 10:12:05 user nova-compute[73158]:     </interface>
Aug 17 10:12:05 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:12:05 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/console.log" append="off"/>
Aug 17 10:12:05 user nova-compute[73158]:     </serial>
Aug 17 10:12:05 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:12:05 user nova-compute[73158]:     <video>
Aug 17 10:12:05 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:05 user nova-compute[73158]:     </video>
Aug 17 10:12:05 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:12:05 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:12:05 user nova-compute[73158]:     </rng>
Aug 17 10:12:05 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:12:05 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:12:05 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:12:05 user nova-compute[73158]:     </memballoon>
Aug 17 10:12:05 user nova-compute[73158]:   </devices>
Aug 17 10:12:05 user nova-compute[73158]: </domain>
Aug 17 10:12:05 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1731755005',display_name='tempest-VolumesAdminNegativeTest-server-1731755005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1731755005',id=7,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbKpon8Q2vw3LAN3SWPZV/UXKCYVS0/vEGGAwJLSYQptFTTqIjg1GxceK0fzUK/fZYNGUYUPyYVm4X4WfFWFtc8uL5h6IaXh4hF2U2uEP6ShyA/QZu6b3C8+1nQ6BACuw==',key_name='tempest-keypair-1794708543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3a5e2269964313aa7a3a3d4d2e604f',ramdisk_id='',reservation_id='r-yhjgv6nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1264923804',owner_user_name='tempest-VolumesAdminNegativeTest-1264923804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8cdcc95e0854d68a15db4d7e3d998e5',uuid=c3b24204-badc-4d40-9b96-5a8b07a49250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converting VIF {"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG os_vif [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: INFO os_vif [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0')
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6281f6ca-0a, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6281f6ca-0a, col_values=(('external_ids', {'iface-id': '6281f6ca-0a00-45f8-907c-1e228b9eccae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:fc:29', 'vm-uuid': 'c3b24204-badc-4d40-9b96-5a8b07a49250'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: INFO os_vif [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a')
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] No VIF found with MAC fa:16:3e:3c:db:35, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No VIF found with MAC fa:16:3e:f2:fc:29, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:12:05 user nova-compute[73158]: INFO nova.compute.claims [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Claim successful on node user
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updated VIF entry in instance network info cache for port 43982739-d0ed-4ec8-9576-31879af40e8a. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updating instance_info_cache with network_info: [{"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-08d9227a-1e4e-4334-a93a-a9134dbd1062 req-7f1ba04e-6006-4d61-9e90-53d2475db844 service nova] Releasing lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:12:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:12:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.policy [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5f22fc20f4d42c1a45bd2f17dcf2313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f861aee784e1fac06d81b3b055859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:12:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:12:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Creating image(s)
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "/opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "/opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "/opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-changed-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Refreshing instance network info cache due to event network-changed-6281f6ca-0a00-45f8-907c-1e228b9eccae. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] Acquiring lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] Acquired lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Refreshing network info cache for port 6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.225s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-8cf7836c-d3d3-45c5-8a9b-99fcfc377e7e req-789b372c-6970-42ef-aca7-35b74b4d118d service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8cf7836c-d3d3-45c5-8a9b-99fcfc377e7e req-789b372c-6970-42ef-aca7-35b74b4d118d service nova] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8cf7836c-d3d3-45c5-8a9b-99fcfc377e7e req-789b372c-6970-42ef-aca7-35b74b4d118d service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8cf7836c-d3d3-45c5-8a9b-99fcfc377e7e req-789b372c-6970-42ef-aca7-35b74b4d118d service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-8cf7836c-d3d3-45c5-8a9b-99fcfc377e7e req-789b372c-6970-42ef-aca7-35b74b4d118d service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] No waiting events found dispatching network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:06 user nova-compute[73158]: WARNING nova.compute.manager [req-8cf7836c-d3d3-45c5-8a9b-99fcfc377e7e req-789b372c-6970-42ef-aca7-35b74b4d118d service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received unexpected event network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 for instance with vm_state active and task_state None.
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267126.5836952, 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:06 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] VM Resumed (Lifecycle Event)
Aug 17 10:12:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Instance spawned successfully.
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.223s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk 1073741824" returned: 0 in 0.064s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:06 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267126.589643, 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:06 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] VM Started (Lifecycle Event)
Aug 17 10:12:06 user nova-compute[73158]: INFO nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Took 9.61 seconds to spawn the instance on the hypervisor.
Aug 17 10:12:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:07 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:07 user nova-compute[73158]: INFO nova.compute.manager [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Took 10.99 seconds to build instance.
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d9272d8a-5b92-43bc-9394-f0458c263370 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.152s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.725s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Cannot resize image /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lazy-loading 'migration_context' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Ensure instance console log exists: /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.network.neutron [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Successfully created port: 077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updated VIF entry in instance network info cache for port 6281f6ca-0a00-45f8-907c-1e228b9eccae. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating instance_info_cache with network_info: [{"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ad3e3bb2-3c3b-4d7a-b3b6-7a483f880b80 req-81cada3a-377b-4423-b6d8-3d1ee1dac725 service nova] Releasing lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-cfead180-08b5-408e-8f8f-15e2888d7f7b req-577dd0fa-451a-4f9f-b3cc-2ea0e2664bd1 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cfead180-08b5-408e-8f8f-15e2888d7f7b req-577dd0fa-451a-4f9f-b3cc-2ea0e2664bd1 service nova] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cfead180-08b5-408e-8f8f-15e2888d7f7b req-577dd0fa-451a-4f9f-b3cc-2ea0e2664bd1 service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cfead180-08b5-408e-8f8f-15e2888d7f7b req-577dd0fa-451a-4f9f-b3cc-2ea0e2664bd1 service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-cfead180-08b5-408e-8f8f-15e2888d7f7b req-577dd0fa-451a-4f9f-b3cc-2ea0e2664bd1 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] No waiting events found dispatching network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:08 user nova-compute[73158]: WARNING nova.compute.manager [req-cfead180-08b5-408e-8f8f-15e2888d7f7b req-577dd0fa-451a-4f9f-b3cc-2ea0e2664bd1 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received unexpected event network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a for instance with vm_state building and task_state spawning.
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] No waiting events found dispatching network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:08 user nova-compute[73158]: WARNING nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received unexpected event network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 for instance with vm_state active and task_state None.
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] No waiting events found dispatching network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:08 user nova-compute[73158]: WARNING nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received unexpected event network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 for instance with vm_state active and task_state None.
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] No waiting events found dispatching network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:08 user nova-compute[73158]: WARNING nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received unexpected event network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 for instance with vm_state active and task_state None.
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] No waiting events found dispatching network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:08 user nova-compute[73158]: WARNING nova.compute.manager [req-7e76c4a5-6018-4fe5-8209-2f0edad9b2b2 req-b03ae29b-7d2c-4d02-86be-e8f841e9c7b7 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received unexpected event network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 for instance with vm_state active and task_state None.
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Successfully updated port: 077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquired lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-changed-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Refreshing instance network info cache due to event network-changed-077d1c5f-3245-4d5b-851a-740deb1acbd5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] Acquiring lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updating instance_info_cache with network_info: [{"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Releasing lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Instance network_info: |[{"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] Acquired lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.neutron [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Refreshing network info cache for port 077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Start _get_guest_xml network_info=[{"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:09 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-842428761',display_name='tempest-TestVolumeSwap-server-842428761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-842428761',id=8,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTiTJpbfP0XPozaajRd/KzR9icIRWvhS16HrBm0kQPzUUFN5zbAJXPt+NX6m6polaDOS7ig8XlX7OqRXjWSGJqm/4ifYsYZ4WkzjgOE+OEzOOEo0pJUNR0H7O7YcOIYVA==',key_name='tempest-keypair-1143540003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a8f861aee784e1fac06d81b3b055859',ramdisk_id='',reservation_id='r-7jrqxtzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-160536066',owner_user_name='tempest-TestVolumeSwap-160536066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f22fc20f4d42c1a45bd2f17dcf2313',uuid=8775f432-db12-4e5f-b484-37a1922742a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Converting VIF {"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lazy-loading 'pci_devices' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:12:09 user nova-compute[73158]:   <uuid>8775f432-db12-4e5f-b484-37a1922742a6</uuid>
Aug 17 10:12:09 user nova-compute[73158]:   <name>instance-00000008</name>
Aug 17 10:12:09 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:12:09 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:12:09 user nova-compute[73158]:   <metadata>
Aug 17 10:12:09 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:12:09 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:12:09 user nova-compute[73158]:       <nova:name>tempest-TestVolumeSwap-server-842428761</nova:name>
Aug 17 10:12:09 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:12:09</nova:creationTime>
Aug 17 10:12:09 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:12:09 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:12:09 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:12:09 user nova-compute[73158]:       <nova:owner>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:user uuid="a5f22fc20f4d42c1a45bd2f17dcf2313">tempest-TestVolumeSwap-160536066-project-member</nova:user>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:project uuid="6a8f861aee784e1fac06d81b3b055859">tempest-TestVolumeSwap-160536066</nova:project>
Aug 17 10:12:09 user nova-compute[73158]:       </nova:owner>
Aug 17 10:12:09 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:12:09 user nova-compute[73158]:       <nova:ports>
Aug 17 10:12:09 user nova-compute[73158]:         <nova:port uuid="077d1c5f-3245-4d5b-851a-740deb1acbd5">
Aug 17 10:12:09 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 10:12:09 user nova-compute[73158]:         </nova:port>
Aug 17 10:12:09 user nova-compute[73158]:       </nova:ports>
Aug 17 10:12:09 user nova-compute[73158]:     </nova:instance>
Aug 17 10:12:09 user nova-compute[73158]:   </metadata>
Aug 17 10:12:09 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:12:09 user nova-compute[73158]:     <system>
Aug 17 10:12:09 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:12:09 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:12:09 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:12:09 user nova-compute[73158]:       <entry name="serial">8775f432-db12-4e5f-b484-37a1922742a6</entry>
Aug 17 10:12:09 user nova-compute[73158]:       <entry name="uuid">8775f432-db12-4e5f-b484-37a1922742a6</entry>
Aug 17 10:12:09 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:12:09 user nova-compute[73158]:     </system>
Aug 17 10:12:09 user nova-compute[73158]:   </sysinfo>
Aug 17 10:12:09 user nova-compute[73158]:   <os>
Aug 17 10:12:09 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:12:09 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:12:09 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:12:09 user nova-compute[73158]:   </os>
Aug 17 10:12:09 user nova-compute[73158]:   <features>
Aug 17 10:12:09 user nova-compute[73158]:     <acpi/>
Aug 17 10:12:09 user nova-compute[73158]:     <apic/>
Aug 17 10:12:09 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:12:09 user nova-compute[73158]:   </features>
Aug 17 10:12:09 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:12:09 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:12:09 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:12:09 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:12:09 user nova-compute[73158]:   </clock>
Aug 17 10:12:09 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:12:09 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:12:09 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:12:09 user nova-compute[73158]:   </cpu>
Aug 17 10:12:09 user nova-compute[73158]:   <devices>
Aug 17 10:12:09 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:12:09 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:12:09 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk"/>
Aug 17 10:12:09 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:12:09 user nova-compute[73158]:     </disk>
Aug 17 10:12:09 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:12:09 user nova-compute[73158]:       <mac address="fa:16:3e:4f:6f:bd"/>
Aug 17 10:12:09 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:09 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:12:09 user nova-compute[73158]:       <target dev="tap077d1c5f-32"/>
Aug 17 10:12:09 user nova-compute[73158]:     </interface>
Aug 17 10:12:09 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:12:09 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/console.log" append="off"/>
Aug 17 10:12:09 user nova-compute[73158]:     </serial>
Aug 17 10:12:09 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:12:09 user nova-compute[73158]:     <video>
Aug 17 10:12:09 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:09 user nova-compute[73158]:     </video>
Aug 17 10:12:09 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:12:09 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:12:09 user nova-compute[73158]:     </rng>
Aug 17 10:12:09 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:12:09 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:12:09 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:12:09 user nova-compute[73158]:     </memballoon>
Aug 17 10:12:09 user nova-compute[73158]:   </devices>
Aug 17 10:12:09 user nova-compute[73158]: </domain>
Aug 17 10:12:09 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-842428761',display_name='tempest-TestVolumeSwap-server-842428761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-842428761',id=8,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTiTJpbfP0XPozaajRd/KzR9icIRWvhS16HrBm0kQPzUUFN5zbAJXPt+NX6m6polaDOS7ig8XlX7OqRXjWSGJqm/4ifYsYZ4WkzjgOE+OEzOOEo0pJUNR0H7O7YcOIYVA==',key_name='tempest-keypair-1143540003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a8f861aee784e1fac06d81b3b055859',ramdisk_id='',reservation_id='r-7jrqxtzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-160536066',owner_user_name='tempest-TestVolumeSwap-160536066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f22fc20f4d42c1a45bd2f17dcf2313',uuid=8775f432-db12-4e5f-b484-37a1922742a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Converting VIF {"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG os_vif [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap077d1c5f-32, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap077d1c5f-32, col_values=(('external_ids', {'iface-id': '077d1c5f-3245-4d5b-851a-740deb1acbd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6f:bd', 'vm-uuid': '8775f432-db12-4e5f-b484-37a1922742a6'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:12:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:09 user nova-compute[73158]: INFO os_vif [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32')
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] No VIF found with MAC fa:16:3e:4f:6f:bd, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updated VIF entry in instance network info cache for port 077d1c5f-3245-4d5b-851a-740deb1acbd5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updating instance_info_cache with network_info: [{"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a6a945d6-8631-4c75-bfbe-f02fa6fe149c req-41e34b40-13d4-48fb-872d-ee4583441515 service nova] Releasing lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] No waiting events found dispatching network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:10 user nova-compute[73158]: WARNING nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received unexpected event network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a for instance with vm_state building and task_state spawning.
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:10 user nova-compute[73158]: WARNING nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state building and task_state spawning.
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:10 user nova-compute[73158]: WARNING nova.compute.manager [req-87cf4b53-a4c6-4430-99d3-5b62790db08f req-cd4aa6e5-632c-4f5a-a124-e23d489c1f6d service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state building and task_state spawning.
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-ae6496ad-f3bd-45e2-a7ab-d9bc1d0ab9f9 req-07b854a2-7763-402f-ac42-3fe25fde94e9 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ae6496ad-f3bd-45e2-a7ab-d9bc1d0ab9f9 req-07b854a2-7763-402f-ac42-3fe25fde94e9 service nova] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ae6496ad-f3bd-45e2-a7ab-d9bc1d0ab9f9 req-07b854a2-7763-402f-ac42-3fe25fde94e9 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ae6496ad-f3bd-45e2-a7ab-d9bc1d0ab9f9 req-07b854a2-7763-402f-ac42-3fe25fde94e9 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-ae6496ad-f3bd-45e2-a7ab-d9bc1d0ab9f9 req-07b854a2-7763-402f-ac42-3fe25fde94e9 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] No waiting events found dispatching network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:10 user nova-compute[73158]: WARNING nova.compute.manager [req-ae6496ad-f3bd-45e2-a7ab-d9bc1d0ab9f9 req-07b854a2-7763-402f-ac42-3fe25fde94e9 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received unexpected event network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 for instance with vm_state active and task_state None.
Aug 17 10:12:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267131.6102662, c3b24204-badc-4d40-9b96-5a8b07a49250 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] VM Resumed (Lifecycle Event)
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Instance spawned successfully.
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267131.6205635, c3b24204-badc-4d40-9b96-5a8b07a49250 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] VM Started (Lifecycle Event)
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Instance spawned successfully.
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267131.7097335, 4fe0d193-0f59-449a-89d1-e9445cad5038 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] VM Resumed (Lifecycle Event)
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Took 11.31 seconds to spawn the instance on the hypervisor.
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:11 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267131.7261147, 4fe0d193-0f59-449a-89d1-e9445cad5038 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:11 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] VM Started (Lifecycle Event)
Aug 17 10:12:12 user nova-compute[73158]: INFO nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Took 12.41 seconds to spawn the instance on the hypervisor.
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:12 user nova-compute[73158]: INFO nova.compute.manager [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Took 13.53 seconds to build instance.
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7458729d-3d7c-45b3-9138-e05d5d8996ef tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.682s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:12 user nova-compute[73158]: INFO nova.compute.manager [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Took 14.14 seconds to build instance.
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a9e09be-463f-4eb9-8b27-f6d6ac73f9f4 tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.366s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] No waiting events found dispatching network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:12 user nova-compute[73158]: WARNING nova.compute.manager [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received unexpected event network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 for instance with vm_state building and task_state spawning.
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] No waiting events found dispatching network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:12 user nova-compute[73158]: WARNING nova.compute.manager [req-05aa8a2c-57ac-4148-a1e2-c5744c01e392 req-571d3902-b63d-42a3-930b-f751c56909ba service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received unexpected event network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 for instance with vm_state building and task_state spawning.
Aug 17 10:12:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:12:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:12:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:12:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267134.5849898, 8775f432-db12-4e5f-b484-37a1922742a6 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] VM Resumed (Lifecycle Event)
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Instance spawned successfully.
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267134.586419, 8775f432-db12-4e5f-b484-37a1922742a6 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] VM Started (Lifecycle Event)
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Took 8.59 seconds to spawn the instance on the hypervisor.
Aug 17 10:12:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:14 user nova-compute[73158]: INFO nova.compute.manager [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Took 9.66 seconds to build instance.
Aug 17 10:12:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-df67cbf8-9404-44e2-b255-56c76424a1c7 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.822s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:12:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-71f0560e-adc0-4a0b-8520-a6f13a9a148b req-eb870150-2de7-45b9-a101-3cdcda7ce449 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-71f0560e-adc0-4a0b-8520-a6f13a9a148b req-eb870150-2de7-45b9-a101-3cdcda7ce449 service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-71f0560e-adc0-4a0b-8520-a6f13a9a148b req-eb870150-2de7-45b9-a101-3cdcda7ce449 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-71f0560e-adc0-4a0b-8520-a6f13a9a148b req-eb870150-2de7-45b9-a101-3cdcda7ce449 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-71f0560e-adc0-4a0b-8520-a6f13a9a148b req-eb870150-2de7-45b9-a101-3cdcda7ce449 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:20 user nova-compute[73158]: WARNING nova.compute.manager [req-71f0560e-adc0-4a0b-8520-a6f13a9a148b req-eb870150-2de7-45b9-a101-3cdcda7ce449 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state None.
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:21 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:21 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:21 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=24.758026123046875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:12:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-5dc70f41-01ad-4c50-8012-d6c85437a87b req-61c9b715-fd1d-47f4-81c1-7806e3c710cd service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5dc70f41-01ad-4c50-8012-d6c85437a87b req-61c9b715-fd1d-47f4-81c1-7806e3c710cd service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5dc70f41-01ad-4c50-8012-d6c85437a87b req-61c9b715-fd1d-47f4-81c1-7806e3c710cd service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5dc70f41-01ad-4c50-8012-d6c85437a87b req-61c9b715-fd1d-47f4-81c1-7806e3c710cd service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-5dc70f41-01ad-4c50-8012-d6c85437a87b req-61c9b715-fd1d-47f4-81c1-7806e3c710cd service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:22 user nova-compute[73158]: WARNING nova.compute.manager [req-5dc70f41-01ad-4c50-8012-d6c85437a87b req-61c9b715-fd1d-47f4-81c1-7806e3c710cd service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state None.
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e86f76e1-8c60-48df-97a4-83e356392908 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe0d193-0f59-449a-89d1-e9445cad5038 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c3b24204-badc-4d40-9b96-5a8b07a49250 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8775f432-db12-4e5f-b484-37a1922742a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.853s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:12:23 user nova-compute[73158]: INFO nova.compute.claims [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Claim successful on node user
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.812s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:12:23 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:12:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG nova.policy [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd84e880a3e2f4707b3d58e353281fbd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c1113c081e46ada5ee3a9ca5004d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:12:24 user nova-compute[73158]: INFO nova.virt.block_device [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Booting with volume e8947c30-7d7a-4fa1-a4d6-21bab03655a0 at /dev/vda
Aug 17 10:12:24 user nova-compute[73158]: DEBUG os_brick.utils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:12:24 user nova-compute[73158]: INFO oslo.privsep.daemon [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7_e0wbga/privsep.sock']
Aug 17 10:12:24 user sudo[83936]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7_e0wbga/privsep.sock
Aug 17 10:12:24 user sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 10:12:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Skipping network cache update for instance because it is Building. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Successfully created port: 6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:12:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Successfully updated port: 6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquired lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-changed-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Refreshing instance network info cache due to event network-changed-6f21dff0-22a2-431e-ab50-33b7956a0a5f. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] Acquiring lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:26 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:12:26 user sudo[83936]: pam_unix(sudo:session): session closed for user root
Aug 17 10:12:27 user nova-compute[73158]: INFO oslo.privsep.daemon [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Spawned new privsep daemon via rootwrap
Aug 17 10:12:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 10:12:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 10:12:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 10:12:27 user nova-compute[73158]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84001
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7097c05-522d-4a84-8cbb-570acc123222]: (2,) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating instance_info_cache with network_info: [{"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e29ed-9d1d-415f-88dd-463ac12918a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:27 user nova-compute[73158]: WARNING os_brick.initiator.connectors.nvmeof [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Releasing lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance network_info: |[{"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] Acquired lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG nova.network.neutron [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Refreshing network info cache for port 6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9041b89-c1f2-4e06-b47e-62d0244a02a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f3a4be-768e-4694-9d2a-7a1ce9066bbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c7c84-2bd3-4b5c-9f6b-7a5199f1a61c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:12:27 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:12:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[308d2bda-175e-47e7-ba93-f6cc9afb050d]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG os_brick.utils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== get_connector_properties: return (3191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:12:27 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating existing volume attachment record: 04718940-b849-48a9-b534-75042e5086e9 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:12:28 user nova-compute[73158]: DEBUG nova.network.neutron [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updated VIF entry in instance network info cache for port 6f21dff0-22a2-431e-ab50-33b7956a0a5f. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:12:28 user nova-compute[73158]: DEBUG nova.network.neutron [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating instance_info_cache with network_info: [{"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:12:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-05fd2f54-7245-4ec3-9ba1-45f8aa131dc4 req-43f7d268-09e1-42c6-a725-4e7d7e32acd8 service nova] Releasing lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:12:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:12:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Creating image(s)
Aug 17 10:12:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Ensure instance console log exists: /opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Start _get_guest_xml network_info=[{"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '04718940-b849-48a9-b534-75042e5086e9', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f877b207-950b-4c69-9e6b-29e973f97a0f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8947c30-7d7a-4fa1-a4d6-21bab03655a0', 'serial': 'e8947c30-7d7a-4fa1-a4d6-21bab03655a0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:12:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:12:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connector [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Factory for ISCSI on None {{(pid=73158) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:12:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:12:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:12:40 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea938f2-207f-467c-a978-b0f9b96f43b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:12:40 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ef259-3915-4504-a447-db1c47cddf9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0] added
Aug 17 10:12:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f43e84-4729-4e09-8078-783bae4abe4f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9d289-52a9-4d9a-b1b5-770eaa8235f2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfivLalV {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfivLalV" returned: 0 in 0.086s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d10a23-4bc0-45b0-817e-0b2b3f73baa6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfivLalV'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eb805b-9961-40c4-81ac-f770a879081b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7848d03e-89a0-4b83-bc52-d4fe624f08c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:12:40 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:12:40 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:12:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:12:40 user nova-compute[73158]: 
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e832e8-611d-45cd-a1a0-5f89fea2a889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]
Aug 17 10:12:40 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.
Aug 17 10:12:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[be52c41d-6102-44f2-8234-8e3ba946ce79]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a782245f-77d8-495d-bb97-3a6aea263475]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:12:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:12:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a61aaf3-d616-4356-865e-8461d8ebdc5c]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:12:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23335326636636130', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335326636636130', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1830998465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1830998465',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp13s87YsSP5hXLXc3oT8gJDyNrfg0qxxuhSOTIUV/wq7nkQKQpqWZkXMVscmA9MWfKqzW6Zzzyd6dWMztqDvVyV/bCj1V6/KYCJfxNHY0Rts1QnrfR7feMD/5zrB3fOQ==',key_name='tempest-keypair-1685511148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c1113c081e46ada5ee3a9ca5004d15',ramdisk_id='',reservation_id='r-jbslfto5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1012743389',owner_user_name='tempest-ServerActionsV293TestJSON-1012743389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d84e880a3e2f4707b3d58e353281fbd0',uuid=f877b207-950b-4c69-9e6b-29e973f97a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converting VIF {"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'pci_devices' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:12:41 user nova-compute[73158]:   <uuid>f877b207-950b-4c69-9e6b-29e973f97a0f</uuid>
Aug 17 10:12:41 user nova-compute[73158]:   <name>instance-00000009</name>
Aug 17 10:12:41 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:12:41 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:12:41 user nova-compute[73158]:   <metadata>
Aug 17 10:12:41 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:12:41 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:12:41 user nova-compute[73158]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1830998465</nova:name>
Aug 17 10:12:41 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:12:39</nova:creationTime>
Aug 17 10:12:41 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:12:41 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:12:41 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:12:41 user nova-compute[73158]:       <nova:owner>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:user uuid="d84e880a3e2f4707b3d58e353281fbd0">tempest-ServerActionsV293TestJSON-1012743389-project-member</nova:user>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:project uuid="85c1113c081e46ada5ee3a9ca5004d15">tempest-ServerActionsV293TestJSON-1012743389</nova:project>
Aug 17 10:12:41 user nova-compute[73158]:       </nova:owner>
Aug 17 10:12:41 user nova-compute[73158]:       <nova:ports>
Aug 17 10:12:41 user nova-compute[73158]:         <nova:port uuid="6f21dff0-22a2-431e-ab50-33b7956a0a5f">
Aug 17 10:12:41 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:12:41 user nova-compute[73158]:         </nova:port>
Aug 17 10:12:41 user nova-compute[73158]:       </nova:ports>
Aug 17 10:12:41 user nova-compute[73158]:     </nova:instance>
Aug 17 10:12:41 user nova-compute[73158]:   </metadata>
Aug 17 10:12:41 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:12:41 user nova-compute[73158]:     <system>
Aug 17 10:12:41 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:12:41 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:12:41 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:12:41 user nova-compute[73158]:       <entry name="serial">f877b207-950b-4c69-9e6b-29e973f97a0f</entry>
Aug 17 10:12:41 user nova-compute[73158]:       <entry name="uuid">f877b207-950b-4c69-9e6b-29e973f97a0f</entry>
Aug 17 10:12:41 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:12:41 user nova-compute[73158]:     </system>
Aug 17 10:12:41 user nova-compute[73158]:   </sysinfo>
Aug 17 10:12:41 user nova-compute[73158]:   <os>
Aug 17 10:12:41 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:12:41 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:12:41 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:12:41 user nova-compute[73158]:   </os>
Aug 17 10:12:41 user nova-compute[73158]:   <features>
Aug 17 10:12:41 user nova-compute[73158]:     <acpi/>
Aug 17 10:12:41 user nova-compute[73158]:     <apic/>
Aug 17 10:12:41 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:12:41 user nova-compute[73158]:   </features>
Aug 17 10:12:41 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:12:41 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:12:41 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:12:41 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:12:41 user nova-compute[73158]:   </clock>
Aug 17 10:12:41 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:12:41 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:12:41 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:12:41 user nova-compute[73158]:   </cpu>
Aug 17 10:12:41 user nova-compute[73158]:   <devices>
Aug 17 10:12:41 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:12:41 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:12:41 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:12:41 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:12:41 user nova-compute[73158]:       <serial>e8947c30-7d7a-4fa1-a4d6-21bab03655a0</serial>
Aug 17 10:12:41 user nova-compute[73158]:     </disk>
Aug 17 10:12:41 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:12:41 user nova-compute[73158]:       <mac address="fa:16:3e:06:22:49"/>
Aug 17 10:12:41 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:41 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:12:41 user nova-compute[73158]:       <target dev="tap6f21dff0-22"/>
Aug 17 10:12:41 user nova-compute[73158]:     </interface>
Aug 17 10:12:41 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:12:41 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f/console.log" append="off"/>
Aug 17 10:12:41 user nova-compute[73158]:     </serial>
Aug 17 10:12:41 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:12:41 user nova-compute[73158]:     <video>
Aug 17 10:12:41 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:12:41 user nova-compute[73158]:     </video>
Aug 17 10:12:41 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:12:41 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:12:41 user nova-compute[73158]:     </rng>
Aug 17 10:12:41 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:12:41 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:12:41 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:12:41 user nova-compute[73158]:     </memballoon>
Aug 17 10:12:41 user nova-compute[73158]:   </devices>
Aug 17 10:12:41 user nova-compute[73158]: </domain>
Aug 17 10:12:41 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1830998465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1830998465',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp13s87YsSP5hXLXc3oT8gJDyNrfg0qxxuhSOTIUV/wq7nkQKQpqWZkXMVscmA9MWfKqzW6Zzzyd6dWMztqDvVyV/bCj1V6/KYCJfxNHY0Rts1QnrfR7feMD/5zrB3fOQ==',key_name='tempest-keypair-1685511148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c1113c081e46ada5ee3a9ca5004d15',ramdisk_id='',reservation_id='r-jbslfto5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1012743389',owner_user_name='tempest-ServerActionsV293TestJSON-1012743389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d84e880a3e2f4707b3d58e353281fbd0',uuid=f877b207-950b-4c69-9e6b-29e973f97a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converting VIF {"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG os_vif [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f21dff0-22, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f21dff0-22, col_values=(('external_ids', {'iface-id': '6f21dff0-22a2-431e-ab50-33b7956a0a5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:22:49', 'vm-uuid': 'f877b207-950b-4c69-9e6b-29e973f97a0f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:41 user nova-compute[73158]: INFO os_vif [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22')
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:12:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] No VIF found with MAC fa:16:3e:06:22:49, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-0c1fa470-cb8b-4db4-9a97-4c06be5052d6 req-79f9da11-f0bb-4ce6-973e-d0e5b62ac284 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0c1fa470-cb8b-4db4-9a97-4c06be5052d6 req-79f9da11-f0bb-4ce6-973e-d0e5b62ac284 service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0c1fa470-cb8b-4db4-9a97-4c06be5052d6 req-79f9da11-f0bb-4ce6-973e-d0e5b62ac284 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0c1fa470-cb8b-4db4-9a97-4c06be5052d6 req-79f9da11-f0bb-4ce6-973e-d0e5b62ac284 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-0c1fa470-cb8b-4db4-9a97-4c06be5052d6 req-79f9da11-f0bb-4ce6-973e-d0e5b62ac284 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:43 user nova-compute[73158]: WARNING nova.compute.manager [req-0c1fa470-cb8b-4db4-9a97-4c06be5052d6 req-79f9da11-f0bb-4ce6-973e-d0e5b62ac284 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state building and task_state spawning.
Aug 17 10:12:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267165.6762753, f877b207-950b-4c69-9e6b-29e973f97a0f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] VM Resumed (Lifecycle Event)
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance spawned successfully.
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267165.6766694, f877b207-950b-4c69-9e6b-29e973f97a0f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] VM Started (Lifecycle Event)
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-f3dc0fe5-f0cd-47d2-9a22-be58a929d845 req-c93a3bfc-c3cc-4ad5-827a-91d27fd82f7d service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f3dc0fe5-f0cd-47d2-9a22-be58a929d845 req-c93a3bfc-c3cc-4ad5-827a-91d27fd82f7d service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f3dc0fe5-f0cd-47d2-9a22-be58a929d845 req-c93a3bfc-c3cc-4ad5-827a-91d27fd82f7d service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f3dc0fe5-f0cd-47d2-9a22-be58a929d845 req-c93a3bfc-c3cc-4ad5-827a-91d27fd82f7d service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-f3dc0fe5-f0cd-47d2-9a22-be58a929d845 req-c93a3bfc-c3cc-4ad5-827a-91d27fd82f7d service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:12:45 user nova-compute[73158]: WARNING nova.compute.manager [req-f3dc0fe5-f0cd-47d2-9a22-be58a929d845 req-c93a3bfc-c3cc-4ad5-827a-91d27fd82f7d service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state building and task_state spawning.
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 17 10:12:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:12:45 user nova-compute[73158]: INFO nova.compute.manager [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Took 22.94 seconds to build instance.
Aug 17 10:12:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ed3a1072-e2e4-42d0-85d3-32a7e5c1dbed tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.275s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:12:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:12:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:52 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:12:52 user nova-compute[73158]: INFO nova.compute.claims [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Claim successful on node user
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:12:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:12:53 user nova-compute[73158]: INFO nova.virt.block_device [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Booting with volume aa98d820-5ff7-4dbf-aca7-8fbdb522e375 at /dev/vda
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.policy [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbbcb454697e46898d182e727c4d5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fedff7020141198e351516a0242942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1b7bbf-7edc-4cc9-8d64-a291ed9e1938]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58bc70-ab04-419e-8a7f-7e5275aa7f47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3220f434-c334-4e1f-b2c3-b898b272e9c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d133e391-1d2c-4d80-ac2a-47818342eeef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:12:53 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:12:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef01bb-cfb3-4c72-848f-795e6a80f896]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:12:53 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating existing volume attachment record: 22e4b74b-d178-47d6-9f6c-1541298577d3 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully created port: bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Acquiring lock "70c7bb53-8a39-4f8c-af66-4376b9fdead6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Lock "70c7bb53-8a39-4f8c-af66-4376b9fdead6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:12:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:12:54 user nova-compute[73158]: INFO nova.compute.claims [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Claim successful on node user
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully created port: b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:12:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:12:55 user nova-compute[73158]: INFO nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Booting with volume 060795e2-b587-4723-a4c0-36123108a1f7 at /dev/vda
Aug 17 10:12:55 user nova-compute[73158]: DEBUG os_brick.utils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db78e53-bd80-40c8-b03f-d392ebf6ee9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c970ec9-ff21-4d58-a5d9-7303206a6f50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[417a4d6c-70fe-4194-b319-33227ba520d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1bd2b-1ad8-4bd7-9aaf-0d1d2bedd972]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:12:55 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:12:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[084997ad-3ffb-4f14-8fd7-2cc5b46311df]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG os_brick.utils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating existing volume attachment record: d46a4ca0-5976-48be-b39e-d032bfcf9e6b {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.policy [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62bfe5791c2c43c485295024593cbf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bade6c214c614d42ab7676c9ef41565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:12:55 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully created port: 31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:12:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully created port: e5d8f917-4ef1-4cde-af69-f0225174b224 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:57 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully created port: 36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully created port: ed94946d-5eeb-4c2e-8a8f-b1672d15a24b {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully created port: de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully created port: 051a238e-f680-40c2-8ed1-9bef1ebc9856 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:12:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-45af711b-0a65-4b25-99f6-a73af51e4e40 req-9837bc74-a56c-41c9-84ef-e9a912015914 service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully created port: f9f7266f-045d-48ed-ba91-4a9efc4d6bbd {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:13:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully created port: 269e885b-027d-4fb1-82a9-f315f97ab475 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-f53e3226-bc3d-4098-a408-c6e3f2b9863f. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9a54c22a-8b1f-4962-b51b-b38a9b26f7c2 req-344266e0-5310-4d14-baaa-30ab84d7c010 service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: e5d8f917-4ef1-4cde-af69-f0225174b224 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-f93ab344-3dd8-4042-a095-240db4de39ca. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:03 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-e5d8f917-4ef1-4cde-af69-f0225174b224 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-e5d8f917-4ef1-4cde-af69-f0225174b224. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port e5d8f917-4ef1-4cde-af69-f0225174b224 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: f207fc1d-4961-48c8-82cb-b57813716c35 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-b341c9f6-3dc9-4097-a98e-55f60f09de5e. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb2abfce-f94b-420b-8066-52737b0bdf74 req-33c10297-5b12-41eb-991c-f180534f9cd9 service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: 31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: a7c929af-2861-4789-8d83-21a6a7092b57 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-f207fc1d-4961-48c8-82cb-b57813716c35 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-f207fc1d-4961-48c8-82cb-b57813716c35. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port f207fc1d-4961-48c8-82cb-b57813716c35 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-31092420-8772-42ab-a035-b1d08f9e5ee5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port 31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: 36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-a7c929af-2861-4789-8d83-21a6a7092b57 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-a7c929af-2861-4789-8d83-21a6a7092b57. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port a7c929af-2861-4789-8d83-21a6a7092b57 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: ed94946d-5eeb-4c2e-8a8f-b1672d15a24b {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-01a7fa5e-a87b-4584-9acd-adc793f4c75d req-9ccd4758-4b84-4a7e-a4e3-f9d8c06bb866 service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-36768574-c029-4535-b556-3f4e873766c4. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port 36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Successfully updated port: de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-ed94946d-5eeb-4c2e-8a8f-b1672d15a24b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-ed94946d-5eeb-4c2e-8a8f-b1672d15a24b. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port ed94946d-5eeb-4c2e-8a8f-b1672d15a24b {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: 051a238e-f680-40c2-8ed1-9bef1ebc9856 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-647fe8fc-f789-47b9-b589-25d4e3bb639e req-b915e11a-715f-4e3c-9133-ceb30be6795d service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:09 user nova-compute[73158]: INFO nova.virt.block_device [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Booting with volume e668b874-b981-46b8-867f-817aa3374b6f at /dev/vdb
Aug 17 10:13:09 user nova-compute[73158]: DEBUG os_brick.utils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[605240ed-b1b9-493c-bb67-2e9f6728c16e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547c6fa-468f-44ed-83be-6c196828b272]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dad35f-f623-432e-8d91-24226b7c79f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbf88fd-5f47-4690-b8fa-13c17eff3209]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:09 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b644d0fc-3076-475b-a2bc-a5f08d62033d]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG os_brick.utils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:09 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating existing volume attachment record: af6cc456-ec87-493f-b550-deb9d143137f {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-de7017b5-e1a6-4af6-a409-04e6444085b2. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:10 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: f9f7266f-045d-48ed-ba91-4a9efc4d6bbd {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Successfully updated port: 269e885b-027d-4fb1-82a9-f315f97ab475 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-f9f7266f-045d-48ed-ba91-4a9efc4d6bbd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-f9f7266f-045d-48ed-ba91-4a9efc4d6bbd. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance network_info: |[{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:12 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updated VIF entry in instance network info cache for port de7017b5-e1a6-4af6-a409-04e6444085b2. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-051a238e-f680-40c2-8ed1-9bef1ebc9856 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-051a238e-f680-40c2-8ed1-9bef1ebc9856. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [{"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance network_info: |[{"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:13:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port f9f7266f-045d-48ed-ba91-4a9efc4d6bbd {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updated VIF entry in instance network info cache for port f9f7266f-045d-48ed-ba91-4a9efc4d6bbd. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [{"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Received event network-changed-269e885b-027d-4fb1-82a9-f315f97ab475 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing instance network info cache due to event network-changed-269e885b-027d-4fb1-82a9-f315f97ab475. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] Acquiring lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port 269e885b-027d-4fb1-82a9-f315f97ab475 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:15 user nova-compute[73158]: INFO nova.compute.manager [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Rescuing
Aug 17 10:13:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG nova.network.neutron [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:13:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updated VIF entry in instance network info cache for port 269e885b-027d-4fb1-82a9-f315f97ab475. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [{"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-14175dd2-f203-4e45-a788-a218775de5a0 req-b62bb4b2-29be-413f-9fe0-165c7e1bb18e service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] Acquired lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Refreshing network info cache for port 051a238e-f680-40c2-8ed1-9bef1ebc9856 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updated VIF entry in instance network info cache for port 051a238e-f680-40c2-8ed1-9bef1ebc9856. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [{"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-2ae7771a-6bfa-4c14-b9ca-9a076922eb9d req-ed18e9db-dd5f-4cad-bdd1-8a433a8a6415 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-unplugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ae7771a-6bfa-4c14-b9ca-9a076922eb9d req-ed18e9db-dd5f-4cad-bdd1-8a433a8a6415 service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ae7771a-6bfa-4c14-b9ca-9a076922eb9d req-ed18e9db-dd5f-4cad-bdd1-8a433a8a6415 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ae7771a-6bfa-4c14-b9ca-9a076922eb9d req-ed18e9db-dd5f-4cad-bdd1-8a433a8a6415 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-2ae7771a-6bfa-4c14-b9ca-9a076922eb9d req-ed18e9db-dd5f-4cad-bdd1-8a433a8a6415 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-unplugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:17 user nova-compute[73158]: WARNING nova.compute.manager [req-2ae7771a-6bfa-4c14-b9ca-9a076922eb9d req-ed18e9db-dd5f-4cad-bdd1-8a433a8a6415 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-unplugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state active and task_state rescuing.
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4f4421e-8cda-4604-b815-86fad36e51f6 req-31024779-763e-4f0f-ad45-9c33be9cbfef service nova] Releasing lock "refresh_cache-70c7bb53-8a39-4f8c-af66-4376b9fdead6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:13:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance destroyed successfully.
Aug 17 10:13:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Attempting rescue
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73158) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:13:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Creating image(s)
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:17 user nova-compute[73158]: INFO nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Booting with volume b07c90c8-cb6c-4bcc-9daa-35738d79ff1d at /dev/vdb
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG os_brick.utils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c113667b-3cc9-4a97-825c-ba231cd92cb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6586384-2e35-4260-a812-623bb2f40bed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f2d212-ac78-4dc9-a485-0dad116cce60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7fb9fb-282c-4d93-8477-48d45df40e25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:18 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da73ed4-076e-4331-ba94-f1daa4c28bbd]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG os_brick.utils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating existing volume attachment record: 830e970a-0328-4734-a0a1-3564abedd393 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.313s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue" returned: 0 in 0.057s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'migration_context' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Start _get_guest_xml network_info=[{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:bd:d8:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'resources' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'numa_topology' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:13:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-776375975',display_name='tempest-ServerRescueNegativeTestJSON-server-776375975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-776375975',id=2,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-y6lb094v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:46Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=6450f74c-709c-47b9-9d6a-74aa81de118f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:bd:d8:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:bd:d8:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'pci_devices' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:13:18 user nova-compute[73158]:   <uuid>6450f74c-709c-47b9-9d6a-74aa81de118f</uuid>
Aug 17 10:13:18 user nova-compute[73158]:   <name>instance-00000002</name>
Aug 17 10:13:18 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:13:18 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:13:18 user nova-compute[73158]:   <metadata>
Aug 17 10:13:18 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:13:18 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:13:18 user nova-compute[73158]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-776375975</nova:name>
Aug 17 10:13:18 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:13:18</nova:creationTime>
Aug 17 10:13:18 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:13:18 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:13:18 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:13:18 user nova-compute[73158]:       <nova:owner>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:user uuid="fc72634020f043308464eca253691603">tempest-ServerRescueNegativeTestJSON-1859456269-project-member</nova:user>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:project uuid="0eece5be982b434daf80b44ec022192e">tempest-ServerRescueNegativeTestJSON-1859456269</nova:project>
Aug 17 10:13:18 user nova-compute[73158]:       </nova:owner>
Aug 17 10:13:18 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:13:18 user nova-compute[73158]:       <nova:ports>
Aug 17 10:13:18 user nova-compute[73158]:         <nova:port uuid="507dedf7-8751-47a4-be6a-8e1cab4bd4da">
Aug 17 10:13:18 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:13:18 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:18 user nova-compute[73158]:       </nova:ports>
Aug 17 10:13:18 user nova-compute[73158]:     </nova:instance>
Aug 17 10:13:18 user nova-compute[73158]:   </metadata>
Aug 17 10:13:18 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:13:18 user nova-compute[73158]:     <system>
Aug 17 10:13:18 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:13:18 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:13:18 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:13:18 user nova-compute[73158]:       <entry name="serial">6450f74c-709c-47b9-9d6a-74aa81de118f</entry>
Aug 17 10:13:18 user nova-compute[73158]:       <entry name="uuid">6450f74c-709c-47b9-9d6a-74aa81de118f</entry>
Aug 17 10:13:18 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:13:18 user nova-compute[73158]:     </system>
Aug 17 10:13:18 user nova-compute[73158]:   </sysinfo>
Aug 17 10:13:18 user nova-compute[73158]:   <os>
Aug 17 10:13:18 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:13:18 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:13:18 user nova-compute[73158]:   </os>
Aug 17 10:13:18 user nova-compute[73158]:   <features>
Aug 17 10:13:18 user nova-compute[73158]:     <acpi/>
Aug 17 10:13:18 user nova-compute[73158]:     <apic/>
Aug 17 10:13:18 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:13:18 user nova-compute[73158]:   </features>
Aug 17 10:13:18 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:13:18 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:13:18 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:13:18 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:13:18 user nova-compute[73158]:   </clock>
Aug 17 10:13:18 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:13:18 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:13:18 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:13:18 user nova-compute[73158]:   </cpu>
Aug 17 10:13:18 user nova-compute[73158]:   <devices>
Aug 17 10:13:18 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:13:18 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:13:18 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue"/>
Aug 17 10:13:18 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:13:18 user nova-compute[73158]:     </disk>
Aug 17 10:13:18 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:13:18 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:13:18 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk"/>
Aug 17 10:13:18 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:13:18 user nova-compute[73158]:     </disk>
Aug 17 10:13:18 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:18 user nova-compute[73158]:       <mac address="fa:16:3e:bd:d8:62"/>
Aug 17 10:13:18 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:18 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:18 user nova-compute[73158]:       <target dev="tap507dedf7-87"/>
Aug 17 10:13:18 user nova-compute[73158]:     </interface>
Aug 17 10:13:18 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:13:18 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/console.log" append="off"/>
Aug 17 10:13:18 user nova-compute[73158]:     </serial>
Aug 17 10:13:18 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:13:18 user nova-compute[73158]:     <video>
Aug 17 10:13:18 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:18 user nova-compute[73158]:     </video>
Aug 17 10:13:18 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:13:18 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:13:18 user nova-compute[73158]:     </rng>
Aug 17 10:13:18 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:13:18 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:13:18 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:13:18 user nova-compute[73158]:     </memballoon>
Aug 17 10:13:18 user nova-compute[73158]:   </devices>
Aug 17 10:13:18 user nova-compute[73158]: </domain>
Aug 17 10:13:18 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:13:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance destroyed successfully.
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:13:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:bd:d8:62, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-cb8ee3e9-f6ca-43c3-a819-a0f2fcd3d9ff req-76a49c70-5680-40b3-9293-5c8eacb76b80 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cb8ee3e9-f6ca-43c3-a819-a0f2fcd3d9ff req-76a49c70-5680-40b3-9293-5c8eacb76b80 service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cb8ee3e9-f6ca-43c3-a819-a0f2fcd3d9ff req-76a49c70-5680-40b3-9293-5c8eacb76b80 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cb8ee3e9-f6ca-43c3-a819-a0f2fcd3d9ff req-76a49c70-5680-40b3-9293-5c8eacb76b80 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-cb8ee3e9-f6ca-43c3-a819-a0f2fcd3d9ff req-76a49c70-5680-40b3-9293-5c8eacb76b80 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:19 user nova-compute[73158]: WARNING nova.compute.manager [req-cb8ee3e9-f6ca-43c3-a819-a0f2fcd3d9ff req-76a49c70-5680-40b3-9293-5c8eacb76b80 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state active and task_state rescuing.
Aug 17 10:13:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lazy-loading 'flavor' on Instance uuid e86f76e1-8c60-48df-97a4-83e356392908 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:20 user nova-compute[73158]: INFO nova.compute.manager [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Attaching volume 489b496f-272c-4c77-a597-89f33a7d06a3 to /dev/vdb
Aug 17 10:13:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG os_brick.utils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9278af8-6da3-4545-bca4-9cfa04d5b33f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5dc1ca-cd9e-41f1-b539-1a74a5845469]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafcab01-a6e6-4388-820e-0afde5cdcd84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[42de5d51-73ae-4d41-979c-9d5c9562fa96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:21 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe62e2-6336-429e-9a5a-e0d6bd9f65bc]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG os_brick.utils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Updating existing volume attachment record: 2e95e0b3-a48d-4fff-8bf0-d7f340ec3c21 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:21 user nova-compute[73158]: WARNING nova.compute.manager [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state active and task_state rescuing.
Aug 17 10:13:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:21 user nova-compute[73158]: WARNING nova.compute.manager [req-95064b22-8816-4041-a52b-15481b500c8c req-d49fdcde-a111-4ba6-b033-1174e17b1d59 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state active and task_state rescuing.
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-77ff3d3f-41bb-4bf4-8e94-4e7028cc8c83 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 6450f74c-709c-47b9-9d6a-74aa81de118f due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267202.5085003, 6450f74c-709c-47b9-9d6a-74aa81de118f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:13:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] VM Resumed (Lifecycle Event)
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:13:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267202.5099711, 6450f74c-709c-47b9-9d6a-74aa81de118f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:13:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] VM Started (Lifecycle Event)
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-changed-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Refreshing instance network info cache due to event network-changed-109973c2-4d29-48ed-8141-e45dc9ec66f7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG nova.network.neutron [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Refreshing network info cache for port 109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG nova.network.neutron [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated VIF entry in instance network info cache for port 109973c2-4d29-48ed-8141-e45dc9ec66f7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG nova.network.neutron [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-530f251e-d047-424b-946c-a73eba2675dc req-e88ebb1a-43f7-4db0-b631-0720219fc26f service nova] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:25 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:13:25 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7166MB free_disk=24.630050659179688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e86f76e1-8c60-48df-97a4-83e356392908 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe0d193-0f59-449a-89d1-e9445cad5038 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c3b24204-badc-4d40-9b96-5a8b07a49250 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8775f432-db12-4e5f-b484-37a1922742a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f877b207-950b-4c69-9e6b-29e973f97a0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 0a009128-dfff-4daf-b52c-28c6a06020ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 70c7bb53-8a39-4f8c-af66-4376b9fdead6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:13:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:33 user nova-compute[73158]: INFO nova.virt.block_device [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Booting with volume 41b9895c-8274-4bbd-a2b4-4a01e951de83 at /dev/vdc
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.utils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea614a6-c8ff-4e56-a3f3-2a00c1c29d0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bacb93-449d-4d5d-a585-d24b7ed47181]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a7f54-9149-473a-9f28-078c54e915eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f3066-eb5b-489d-88c3-09a1ba44b666]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:33 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4250bf6-e88f-4d01-89d0-b04f9f2e9161]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.utils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating existing volume attachment record: 3b2c8607-ffce-4239-99db-6b5a790fbd3a {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhUVzClx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:33 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:33 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:33 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f616c27-3eff-4bfb-b140-2f221daa1c0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:13:33 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487538e-3392-40f9-8700-b7afcf7e6ed2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3] added
Aug 17 10:13:33 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aea424c-6f54-4ed3-bd53-d6aed4f5e1a4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[887a041c-ec79-4b8f-a4da-5ab10410e036]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhUVzClx {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhUVzClx" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d28d3-20ef-45b2-9458-8a5dcd82e80c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhUVzClx'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c09b39c-56c0-4589-9209-d18bafb40754]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f15aff3-fa07-4d3a-8713-da1c5539d8ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[420dbd3d-2084-497c-a3e8-7ca4288f88f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260]
Aug 17 10:13:34 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260] successful.
Aug 17 10:13:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d466cfd-52d2-4b7b-a877-ecd6c86b085b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[189928b3-e07c-4a3e-8244-ffc80def031b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:34 user nova-compute[73158]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 (non-flash)
Aug 17 10:13:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:34 user nova-compute[73158]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 (non-flash)
Aug 17 10:13:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1410632f-114a-4705-8e83-5a52750bfd17]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:13:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhUVzClx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23734623065626634', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734623065626634', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lazy-loading 'flavor' on Instance uuid e86f76e1-8c60-48df-97a4-83e356392908 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:13:35 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:13:35 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:13:35 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:13:35 user nova-compute[73158]:   <serial>489b496f-272c-4c77-a597-89f33a7d06a3</serial>
Aug 17 10:13:35 user nova-compute[73158]: </disk>
Aug 17 10:13:35 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] No VIF found with MAC fa:16:3e:4e:f2:b4, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:13:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3501092-c2c9-4027-8c36-5b2d6c337174 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.998s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:36 user nova-compute[73158]: INFO nova.compute.manager [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Terminating instance
Aug 17 10:13:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-5c3f494c-38af-42e2-9b50-30f8ce765146 req-0df65132-2165-4849-8334-6281262e7848 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-vif-unplugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5c3f494c-38af-42e2-9b50-30f8ce765146 req-0df65132-2165-4849-8334-6281262e7848 service nova] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5c3f494c-38af-42e2-9b50-30f8ce765146 req-0df65132-2165-4849-8334-6281262e7848 service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5c3f494c-38af-42e2-9b50-30f8ce765146 req-0df65132-2165-4849-8334-6281262e7848 service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-5c3f494c-38af-42e2-9b50-30f8ce765146 req-0df65132-2165-4849-8334-6281262e7848 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] No waiting events found dispatching network-vif-unplugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-5c3f494c-38af-42e2-9b50-30f8ce765146 req-0df65132-2165-4849-8334-6281262e7848 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-vif-unplugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Instance destroyed successfully.
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lazy-loading 'resources' on Instance uuid e86f76e1-8c60-48df-97a4-83e356392908 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-801032636',display_name='tempest-DeleteServersTestJSON-server-801032636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-801032636',id=3,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:11:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c194aec258f5414b95bd1459ce8cdd58',ramdisk_id='',reservation_id='r-28m90t50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-264240806',owner_user_name='tempest-DeleteServersTestJSON-264240806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:11:46Z,user_data=None,user_id='32ee6da717e0430d918febb4a6bdf303',uuid=e86f76e1-8c60-48df-97a4-83e356392908,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Converting VIF {"id": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "address": "fa:16:3e:4e:f2:b4", "network": {"id": "6f609275-f6e1-4923-8882-ebb597c87460", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-332275611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c194aec258f5414b95bd1459ce8cdd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap043c9a6e-f1", "ovs_interfaceid": "043c9a6e-f1db-47f2-992b-7f4ae6954413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_vif [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap043c9a6e-f1, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:37 user nova-compute[73158]: INFO os_vif [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=043c9a6e-f1db-47f2-992b-7f4ae6954413,network=Network(6f609275-f6e1-4923-8882-ebb597c87460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap043c9a6e-f1')
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhUVzClx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:37 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1246c358-e4fd-42b9-8f6e-5e57863a65c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb6e72-2b1b-474a-ba26-2e65548bdaf5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:37 user nova-compute[73158]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 (non-flash)
Aug 17 10:13:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:37 user nova-compute[73158]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 (non-flash)
Aug 17 10:13:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6193f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56928c1-8916-4ccb-858b-d719abf5ff4f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2172d1f-a5a8-4156-a795-6563b351e621]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f184e147-8921-4603-8472-b0240b87c8ee]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d7174d-3413-47ff-b398-1ffbeb5277d9]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d572d216-1666-41c3-9e36-dfbbc1de323b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d56442-2601-4b38-bf18-94c3fc0e0d6b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260]
Aug 17 10:13:37 user nova-compute[73158]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3, portal: 172.16.0.220,3260] successful.
Aug 17 10:13:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[147c9959-5290-489e-b3a6-95ed48a4e770]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] <== disconnect_volume: return (264ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:13:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Deleting instance files /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908_del
Aug 17 10:13:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Deletion of /opt/stack/data/nova/instances/e86f76e1-8c60-48df-97a4-83e356392908_del complete
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73158) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 10:13:37 user nova-compute[73158]: INFO nova.virt.libvirt.host [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] UEFI support detected
Aug 17 10:13:37 user nova-compute[73158]: INFO nova.compute.manager [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 17 10:13:37 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:13:37 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:38 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Took 0.89 seconds to deallocate network for instance.
Aug 17 10:13:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-1ac48caa-0b24-4a18-b388-c58e9f683245 req-34e03937-f24f-404a-b8c3-1afa9df7ab5a service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-vif-deleted-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:38 user nova-compute[73158]: INFO nova.compute.manager [req-1ac48caa-0b24-4a18-b388-c58e9f683245 req-34e03937-f24f-404a-b8c3-1afa9df7ab5a service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Neutron deleted interface 043c9a6e-f1db-47f2-992b-7f4ae6954413; detaching it from the instance and deleting it from the info cache
Aug 17 10:13:38 user nova-compute[73158]: DEBUG nova.network.neutron [req-1ac48caa-0b24-4a18-b388-c58e9f683245 req-34e03937-f24f-404a-b8c3-1afa9df7ab5a service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-1ac48caa-0b24-4a18-b388-c58e9f683245 req-34e03937-f24f-404a-b8c3-1afa9df7ab5a service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Detach interface failed, port_id=043c9a6e-f1db-47f2-992b-7f4ae6954413, reason: Instance e86f76e1-8c60-48df-97a4-83e356392908 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-92efa300-14ba-4f41-a71b-d195675c8f8d req-e2e72baa-9560-4f05-9ad0-f0378d5fc2e3 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received event network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-92efa300-14ba-4f41-a71b-d195675c8f8d req-e2e72baa-9560-4f05-9ad0-f0378d5fc2e3 service nova] Acquiring lock "e86f76e1-8c60-48df-97a4-83e356392908-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-92efa300-14ba-4f41-a71b-d195675c8f8d req-e2e72baa-9560-4f05-9ad0-f0378d5fc2e3 service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-92efa300-14ba-4f41-a71b-d195675c8f8d req-e2e72baa-9560-4f05-9ad0-f0378d5fc2e3 service nova] Lock "e86f76e1-8c60-48df-97a4-83e356392908-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-92efa300-14ba-4f41-a71b-d195675c8f8d req-e2e72baa-9560-4f05-9ad0-f0378d5fc2e3 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] No waiting events found dispatching network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:38 user nova-compute[73158]: WARNING nova.compute.manager [req-92efa300-14ba-4f41-a71b-d195675c8f8d req-e2e72baa-9560-4f05-9ad0-f0378d5fc2e3 service nova] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Received unexpected event network-vif-plugged-043c9a6e-f1db-47f2-992b-7f4ae6954413 for instance with vm_state active and task_state deleting.
Aug 17 10:13:39 user nova-compute[73158]: INFO nova.compute.manager [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 10:13:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:39 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:13:39 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:13:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:39 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Deleted allocations for instance e86f76e1-8c60-48df-97a4-83e356392908
Aug 17 10:13:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-77ae69ad-16d3-4940-a84a-5549fc07b362 tempest-DeleteServersTestJSON-264240806 tempest-DeleteServersTestJSON-264240806-project-member] Lock "e86f76e1-8c60-48df-97a4-83e356392908" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.535s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.volume.cinder [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Update attachment failed for attachment 830e970a-0328-4734-a0a1-3564abedd393. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Traceback (most recent call last):
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     driver_block_device.attach_block_devices(
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     _log_and_attach(device)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     bdm.attach(*attach_args, **attach_kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     ret_val = method(obj, context, *args, **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     self._do_attach(context, instance, volume, volume_api,
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     self._volume_attach(context, volume, connector, instance,
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     connection_info = volume_api.attachment_update(
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     res = method(self, ctx, *args, **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     with excutils.save_and_reraise_exception():
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     self.force_reraise()
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     raise self.value
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     return method.func(obj, *args, **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     resp = self._update('/attachments/%s' % id, body)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     return self.request(url, method, **kwargs)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6]     raise exceptions.from_response(resp, body)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a)
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] 
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.claims [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Aborting claim: <nova.compute.claims.Claim object at 0x7fcc3426ca90> {{(pid=73158) abort /opt/stack/nova/nova/compute/claims.py:84}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.439s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Build of instance 70c7bb53-8a39-4f8c-af66-4376b9fdead6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a) {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.utils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Build of instance 70c7bb53-8a39-4f8c-af66-4376b9fdead6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c9 {{(pid=73158) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:13:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Creating image(s)
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Ensure instance console log exists: /opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Start _get_guest_xml network_info=[{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '22e4b74b-d178-47d6-9f6c-1541298577d3', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbkVHPXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a009128-dfff-4daf-b52c-28c6a06020ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa98d820-5ff7-4dbf-aca7-8fbdb522e375', 'serial': 'aa98d820-5ff7-4dbf-aca7-8fbdb522e375'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'attachment_id': 'af6cc456-ec87-493f-b550-deb9d143137f', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSMhQNsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a009128-dfff-4daf-b52c-28c6a06020ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'e668b874-b981-46b8-867f-817aa3374b6f', 'serial': 'e668b874-b981-46b8-867f-817aa3374b6f'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'attachment_id': '3b2c8607-ffce-4239-99db-6b5a790fbd3a', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJwoiZRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a009128-dfff-4daf-b52c-28c6a06020ea', 'attached_at': '', 'detached_at': '', 'volume_id': '41b9895c-8274-4bbd-a2b4-4a01e951de83', 'serial': '41b9895c-8274-4bbd-a2b4-4a01e951de83'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:13:46 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:13:46 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:13:46 user nova-compute[73158]: ERROR nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Build of instance 70c7bb53-8a39-4f8c-af66-4376b9fdead6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a): nova.exception.BuildAbortException: Build of instance 70c7bb53-8a39-4f8c-af66-4376b9fdead6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b07c90c8-cb6c-4bcc-9daa-35738d79ff1d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:489b496f-272c-4c77-a597-89f33a7d06a3 was not found.).). (HTTP 500) (Request-ID: req-f88cc536-d37e-4962-a08b-a86a244f856a)
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Unplugging VIFs for instance {{(pid=73158) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "e5d8f917-4ef1-4cde-af69-f0225174b224", "address": "fa:16:3e:a2:e8:ec", "network": {"id": "8c568f35-76d7-4ca3-8868-3310f6a2041d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1648976278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d8f917-4e", "ovs_interfaceid": "e5d8f917-4ef1-4cde-af69-f0225174b224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e8:ec,bridge_name='br-int',has_traffic_filtering=True,id=e5d8f917-4ef1-4cde-af69-f0225174b224,network=Network(8c568f35-76d7-4ca3-8868-3310f6a2041d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d8f917-4e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e8:ec,bridge_name='br-int',has_traffic_filtering=True,id=e5d8f917-4ef1-4cde-af69-f0225174b224,network=Network(8c568f35-76d7-4ca3-8868-3310f6a2041d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d8f917-4e') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5d8f917-4e, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e8:ec,bridge_name='br-int',has_traffic_filtering=True,id=e5d8f917-4ef1-4cde-af69-f0225174b224,network=Network(8c568f35-76d7-4ca3-8868-3310f6a2041d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d8f917-4e')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "f207fc1d-4961-48c8-82cb-b57813716c35", "address": "fa:16:3e:2d:62:10", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf207fc1d-49", "ovs_interfaceid": "f207fc1d-4961-48c8-82cb-b57813716c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:62:10,bridge_name='br-int',has_traffic_filtering=True,id=f207fc1d-4961-48c8-82cb-b57813716c35,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf207fc1d-49') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:62:10,bridge_name='br-int',has_traffic_filtering=True,id=f207fc1d-4961-48c8-82cb-b57813716c35,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf207fc1d-49') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf207fc1d-49, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:62:10,bridge_name='br-int',has_traffic_filtering=True,id=f207fc1d-4961-48c8-82cb-b57813716c35,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf207fc1d-49')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "a7c929af-2861-4789-8d83-21a6a7092b57", "address": "fa:16:3e:77:3e:da", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c929af-28", "ovs_interfaceid": "a7c929af-2861-4789-8d83-21a6a7092b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:da,bridge_name='br-int',has_traffic_filtering=True,id=a7c929af-2861-4789-8d83-21a6a7092b57,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7c929af-28') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:da,bridge_name='br-int',has_traffic_filtering=True,id=a7c929af-2861-4789-8d83-21a6a7092b57,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7c929af-28') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbkVHPXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:46 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:46 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7c929af-28, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:da,bridge_name='br-int',has_traffic_filtering=True,id=a7c929af-2861-4789-8d83-21a6a7092b57,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa7c929af-28')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "address": "fa:16:3e:d2:16:ad", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped94946d-5e", "ovs_interfaceid": "ed94946d-5eeb-4c2e-8a8f-b1672d15a24b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:ad,bridge_name='br-int',has_traffic_filtering=True,id=ed94946d-5eeb-4c2e-8a8f-b1672d15a24b,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped94946d-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:ad,bridge_name='br-int',has_traffic_filtering=True,id=ed94946d-5eeb-4c2e-8a8f-b1672d15a24b,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped94946d-5e') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped94946d-5e, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:ad,bridge_name='br-int',has_traffic_filtering=True,id=ed94946d-5eeb-4c2e-8a8f-b1672d15a24b,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped94946d-5e')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "address": "fa:16:3e:08:c7:4f", "network": {"id": "eb3ed47f-5620-4c9a-923b-78615dca7a2c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658083245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a238e-f6", "ovs_interfaceid": "051a238e-f680-40c2-8ed1-9bef1ebc9856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c7:4f,bridge_name='br-int',has_traffic_filtering=True,id=051a238e-f680-40c2-8ed1-9bef1ebc9856,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a238e-f6') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c7:4f,bridge_name='br-int',has_traffic_filtering=True,id=051a238e-f680-40c2-8ed1-9bef1ebc9856,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a238e-f6') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap051a238e-f6, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c24cd66-3f13-4f7a-924f-55ff1d3664cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:13:46 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c7:4f,bridge_name='br-int',has_traffic_filtering=True,id=051a238e-f680-40c2-8ed1-9bef1ebc9856,network=Network(eb3ed47f-5620-4c9a-923b-78615dca7a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a238e-f6')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "address": "fa:16:3e:05:1c:ab", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f7266f-04", "ovs_interfaceid": "f9f7266f-045d-48ed-ba91-4a9efc4d6bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:ab,bridge_name='br-int',has_traffic_filtering=True,id=f9f7266f-045d-48ed-ba91-4a9efc4d6bbd,network=Network(72a1631f-ad20-44fe-b7fc-75f3783d57ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f7266f-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:ab,bridge_name='br-int',has_traffic_filtering=True,id=f9f7266f-045d-48ed-ba91-4a9efc4d6bbd,network=Network(72a1631f-ad20-44fe-b7fc-75f3783d57ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f7266f-04') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f7266f-04, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:ab,bridge_name='br-int',has_traffic_filtering=True,id=f9f7266f-045d-48ed-ba91-4a9efc4d6bbd,network=Network(72a1631f-ad20-44fe-b7fc-75f3783d57ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f7266f-04')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885239313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885239313',id=11,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLlj/2gsc1gqD7giVmK+r1gqWroCa6v0Z3uTHZG+ZfFlFhOdisDe6xmQULg3sD9Xil3sWn76WVwBWJkAiu8AkxMLiIZJTT/BpAHvDpcbLeshVWDss7U+CGi1K2UtuUyw==',key_name='tempest-keypair-1583722073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bade6c214c614d42ab7676c9ef41565f',ramdisk_id='',reservation_id='r-awqsyepm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889903111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889903111-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62bfe5791c2c43c485295024593cbf35',uuid=70c7bb53-8a39-4f8c-af66-4376b9fdead6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converting VIF {"id": "269e885b-027d-4fb1-82a9-f315f97ab475", "address": "fa:16:3e:11:d5:07", "network": {"id": "72a1631f-ad20-44fe-b7fc-75f3783d57ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-523037330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bade6c214c614d42ab7676c9ef41565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269e885b-02", "ovs_interfaceid": "269e885b-027d-4fb1-82a9-f315f97ab475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:d5:07,bridge_name='br-int',has_traffic_filtering=True,id=269e885b-027d-4fb1-82a9-f315f97ab475,network=Network(72a1631f-ad20-44fe-b7fc-75f3783d57ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269e885b-02') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d5:07,bridge_name='br-int',has_traffic_filtering=True,id=269e885b-027d-4fb1-82a9-f315f97ab475,network=Network(72a1631f-ad20-44fe-b7fc-75f3783d57ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269e885b-02') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap269e885b-02, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:46 user nova-compute[73158]: INFO os_vif [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d5:07,bridge_name='br-int',has_traffic_filtering=True,id=269e885b-027d-4fb1-82a9-f315f97ab475,network=Network(72a1631f-ad20-44fe-b7fc-75f3783d57ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269e885b-02')
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Unplugged VIFs for instance {{(pid=73158) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34400977-92be-4155-9ea4-735ae70aafda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375] added
Aug 17 10:13:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf432e54-3515-41fa-896b-63db84e4e060]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[479fc125-feda-4630-8528-f6c379367f06]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbkVHPXd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbkVHPXd" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aeb6b1-2243-4574-8a9e-4c87db1b25fe]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wbkVHPXd'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef325ea-4a8a-4bb0-9fbe-274eb694f27b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e498ca87-9001-4864-ade3-0da0f9999cdf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7901cf00-6fa8-438a-b602-3eb172a64ec3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260]
Aug 17 10:13:46 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260] successful.
Aug 17 10:13:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f13eb8-0334-43b5-af2d-5d713c20587c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa058f-1d22-42f4-be4d-c49bcad5c6b6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:46 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:46 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf1f0df-7271-4f83-a091-49ecb60b71f7]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:13:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbkVHPXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:13:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-changed-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Refreshing instance network info cache due to event network-changed-401613bc-ae59-486b-9aa8-ef866b1dc8d7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] Acquiring lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] Acquired lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:47 user nova-compute[73158]: DEBUG nova.network.neutron [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Refreshing network info cache for port 401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26262383263303533', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383263303533', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSMhQNsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:48 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:48 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:48 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c230e2-711e-449e-95d0-01cd8bf5e646]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:13:48 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed28f76-b922-43bc-bc7a-de256d873484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f] added
Aug 17 10:13:48 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ccc23-0f11-4804-9613-025c1f1a8753]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d5752-48a5-4189-b66d-c6d2f1feb5a2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSMhQNsI {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSMhQNsI" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd9230-f45f-42f3-833e-e38194c0aed0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSMhQNsI'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e225d55a-b6c7-4125-908e-4b77595b3739]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4ab92a-c2ce-4600-9097-86360241f57c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa4eb5-7d0d-41a8-9be9-2ea5f42bf5e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260]
Aug 17 10:13:48 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260] successful.
Aug 17 10:13:48 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d45d0-c03a-440a-8be4-24f24a0f12e3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a9eb33-d82e-42e4-90e4-94f218b3d0a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:13:48 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:48 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:13:48 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8d56a-e465-46e1-b080-1752dbe67b7a]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:13:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSMhQNsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updated VIF entry in instance network info cache for port 401613bc-ae59-486b-9aa8-ef866b1dc8d7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updating instance_info_cache with network_info: [{"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-974098ad-c82c-4dc9-b638-64dbdc085033 req-4f131cbd-e778-47e0-9df3-27f26f418b3f service nova] Releasing lock "refresh_cache-6e23eb52-c52f-4ae4-912c-f7d517ba78a4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23564656336383236', 'path': '/dev/sdd'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564656336383236', 'path': '/dev/sdd'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-changed-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Refreshing instance network info cache due to event network-changed-43982739-d0ed-4ec8-9576-31879af40e8a. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] Acquiring lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] Acquired lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Refreshing network info cache for port 43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJwoiZRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:49 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:49 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:13:49 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2bc440-defd-4c78-9bf5-510d59cdc67d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:13:49 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19428bc-83de-4440-87c5-45d64c053505]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83] added
Aug 17 10:13:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac09170-470d-4f92-ab0c-53bf60940527]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd10b141-0990-487e-88df-feab5d6c179a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJwoiZRK {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJwoiZRK" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff93770-c687-4b97-9bad-9059d1c1ec23]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJwoiZRK'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[215ea925-5486-4a92-b43d-4d5e185ac1a4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[68602b6f-a210-4234-a8cf-33f8a844fa75]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:13:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:13:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.objects.instance [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lazy-loading 'flavor' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84964c10-20a8-4011-8b16-9fdf5dfcfef8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260]
Aug 17 10:13:49 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260] successful.
Aug 17 10:13:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a6d1b-7b94-49c4-8629-602305a72991]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e8aaf-cacf-478f-8954-c575817a4e7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:13:49 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:13:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[658b9e7b-c989-44be-a586-fc0ddd29f0a8]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJwoiZRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-changed-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Refreshing instance network info cache due to event network-changed-6281f6ca-0a00-45f8-907c-1e228b9eccae. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] Acquiring lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] Acquired lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Refreshing network info cache for port 6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:50 user nova-compute[73158]: INFO nova.compute.manager [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Attaching volume c895d036-214c-4750-90d0-b55ca92ddec3 to /dev/vdb
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.utils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[13778c4b-16b2-41c4-9f9e-377821c9795d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c73701-c0a0-4f7d-b7ba-57515589fdcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba54fd6-e2a5-4ac3-be29-f7b820af827f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c9da09-1d43-4b67-9502-c9ff2f333002]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:50 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f02f74a-e395-4958-a1fd-4406487e0752]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.utils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updating existing volume attachment record: aeb3451a-5786-4346-8613-f6415f80409d {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updated VIF entry in instance network info cache for port 6281f6ca-0a00-45f8-907c-1e228b9eccae. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating instance_info_cache with network_info: [{"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e484a15d-2c7e-4977-8534-ef6c95b041ef req-b9c13cc8-58a7-4dec-86af-4b29686dc45f service nova] Releasing lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updated VIF entry in instance network info cache for port 43982739-d0ed-4ec8-9576-31879af40e8a. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updating instance_info_cache with network_info: [{"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9dd0f40d-54f6-4074-8905-350150602d3d req-4055246e-7e2e-42d1-afae-a2759c9d444d service nova] Releasing lock "refresh_cache-4fe0d193-0f59-449a-89d1-e9445cad5038" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26338323839336335', 'path': '/dev/sde'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338323839336335', 'path': '/dev/sde'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a009128-dfff-4daf-b52c-28c6a06020ea {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:13:51 user nova-compute[73158]:   <uuid>0a009128-dfff-4daf-b52c-28c6a06020ea</uuid>
Aug 17 10:13:51 user nova-compute[73158]:   <name>instance-0000000a</name>
Aug 17 10:13:51 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:13:51 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:13:51 user nova-compute[73158]:   <metadata>
Aug 17 10:13:51 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:13:51 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:13:51 user nova-compute[73158]:       <nova:name>tempest-device-tagging-server-414769228</nova:name>
Aug 17 10:13:51 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:13:46</nova:creationTime>
Aug 17 10:13:51 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:13:51 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:13:51 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:13:51 user nova-compute[73158]:       <nova:owner>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:user uuid="fbbcb454697e46898d182e727c4d5f55">tempest-TaggedBootDevicesTest-1220221276-project-member</nova:user>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:project uuid="e3fedff7020141198e351516a0242942">tempest-TaggedBootDevicesTest-1220221276</nova:project>
Aug 17 10:13:51 user nova-compute[73158]:       </nova:owner>
Aug 17 10:13:51 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:13:51 user nova-compute[73158]:       <nova:ports>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="bf29118b-9fd8-4bf8-b932-e86dd5e1c43e">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="f53e3226-bc3d-4098-a408-c6e3f2b9863f">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="f93ab344-3dd8-4042-a095-240db4de39ca">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="b341c9f6-3dc9-4097-a98e-55f60f09de5e">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.1.1.58" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="31092420-8772-42ab-a035-b1d08f9e5ee5">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="36768574-c029-4535-b556-3f4e873766c4">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:         <nova:port uuid="de7017b5-e1a6-4af6-a409-04e6444085b2">
Aug 17 10:13:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 10:13:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:13:51 user nova-compute[73158]:       </nova:ports>
Aug 17 10:13:51 user nova-compute[73158]:     </nova:instance>
Aug 17 10:13:51 user nova-compute[73158]:   </metadata>
Aug 17 10:13:51 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:13:51 user nova-compute[73158]:     <system>
Aug 17 10:13:51 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:13:51 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:13:51 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:13:51 user nova-compute[73158]:       <entry name="serial">0a009128-dfff-4daf-b52c-28c6a06020ea</entry>
Aug 17 10:13:51 user nova-compute[73158]:       <entry name="uuid">0a009128-dfff-4daf-b52c-28c6a06020ea</entry>
Aug 17 10:13:51 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:13:51 user nova-compute[73158]:     </system>
Aug 17 10:13:51 user nova-compute[73158]:   </sysinfo>
Aug 17 10:13:51 user nova-compute[73158]:   <os>
Aug 17 10:13:51 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:13:51 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:13:51 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:13:51 user nova-compute[73158]:   </os>
Aug 17 10:13:51 user nova-compute[73158]:   <features>
Aug 17 10:13:51 user nova-compute[73158]:     <acpi/>
Aug 17 10:13:51 user nova-compute[73158]:     <apic/>
Aug 17 10:13:51 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:13:51 user nova-compute[73158]:   </features>
Aug 17 10:13:51 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:13:51 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:13:51 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:13:51 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:13:51 user nova-compute[73158]:   </clock>
Aug 17 10:13:51 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:13:51 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:13:51 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:13:51 user nova-compute[73158]:   </cpu>
Aug 17 10:13:51 user nova-compute[73158]:   <devices>
Aug 17 10:13:51 user nova-compute[73158]:     <disk type="file" device="cdrom">
Aug 17 10:13:51 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 10:13:51 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea/disk.config"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="hda" bus="ide"/>
Aug 17 10:13:51 user nova-compute[73158]:     </disk>
Aug 17 10:13:51 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:13:51 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:13:51 user nova-compute[73158]:       <source dev="/dev/sdc"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <serial>aa98d820-5ff7-4dbf-aca7-8fbdb522e375</serial>
Aug 17 10:13:51 user nova-compute[73158]:     </disk>
Aug 17 10:13:51 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:13:51 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:13:51 user nova-compute[73158]:       <source dev="/dev/sdd"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <serial>e668b874-b981-46b8-867f-817aa3374b6f</serial>
Aug 17 10:13:51 user nova-compute[73158]:     </disk>
Aug 17 10:13:51 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:13:51 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:13:51 user nova-compute[73158]:       <source dev="/dev/sde"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="vdc" bus="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <serial>41b9895c-8274-4bbd-a2b4-4a01e951de83</serial>
Aug 17 10:13:51 user nova-compute[73158]:     </disk>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:fe:75:95"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tapbf29118b-9f"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:ff:1f:89"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tapf53e3226-bc"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:6d:40:85"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tapf93ab344-3d"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:0c:02:9c"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tapb341c9f6-3d"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:64:62:79"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tap31092420-87"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:45:10:3c"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tap36768574-c0"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:13:51 user nova-compute[73158]:       <mac address="fa:16:3e:ce:40:40"/>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:13:51 user nova-compute[73158]:       <target dev="tapde7017b5-e1"/>
Aug 17 10:13:51 user nova-compute[73158]:     </interface>
Aug 17 10:13:51 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:13:51 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea/console.log" append="off"/>
Aug 17 10:13:51 user nova-compute[73158]:     </serial>
Aug 17 10:13:51 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:13:51 user nova-compute[73158]:     <video>
Aug 17 10:13:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:13:51 user nova-compute[73158]:     </video>
Aug 17 10:13:51 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:13:51 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:13:51 user nova-compute[73158]:     </rng>
Aug 17 10:13:51 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:13:51 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:13:51 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:13:51 user nova-compute[73158]:     </memballoon>
Aug 17 10:13:51 user nova-compute[73158]:   </devices>
Aug 17 10:13:51 user nova-compute[73158]: </domain>
Aug 17 10:13:51 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf29118b-9f, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf29118b-9f, col_values=(('external_ids', {'iface-id': 'bf29118b-9fd8-4bf8-b932-e86dd5e1c43e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:75:95', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf53e3226-bc, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf53e3226-bc, col_values=(('external_ids', {'iface-id': 'f53e3226-bc3d-4098-a408-c6e3f2b9863f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:1f:89', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93ab344-3d, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf93ab344-3d, col_values=(('external_ids', {'iface-id': 'f93ab344-3dd8-4042-a095-240db4de39ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:40:85', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb341c9f6-3d, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb341c9f6-3d, col_values=(('external_ids', {'iface-id': 'b341c9f6-3dc9-4097-a98e-55f60f09de5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:02:9c', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31092420-87, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31092420-87, col_values=(('external_ids', {'iface-id': '31092420-8772-42ab-a035-b1d08f9e5ee5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:62:79', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36768574-c0, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36768574-c0, col_values=(('external_ids', {'iface-id': '36768574-c029-4535-b556-3f4e873766c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:10:3c', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde7017b5-e1, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde7017b5-e1, col_values=(('external_ids', {'iface-id': 'de7017b5-e1a6-4af6-a409-04e6444085b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:40:40', 'vm-uuid': '0a009128-dfff-4daf-b52c-28c6a06020ea'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:51 user nova-compute[73158]: INFO os_vif [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1')
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] No BDM found with device name hda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] No VIF found with MAC fa:16:3e:fe:75:95, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] No VIF found with MAC fa:16:3e:64:62:79, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:13:51 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Using config drive
Aug 17 10:13:51 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Creating config drive at /opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea/disk.config
Aug 17 10:13:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq4vaww1a {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq4vaww1a" returned: 0 in 0.061s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267217.0275009, e86f76e1-8c60-48df-97a4-83e356392908 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:13:52 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: e86f76e1-8c60-48df-97a4-83e356392908] VM Stopped (Lifecycle Event)
Aug 17 10:13:52 user nova-compute[73158]: INFO nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Took 5.38 seconds to deallocate network for instance.
Aug 17 10:13:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ea394613-d176-4572-9463-688f7b7510ce None None] [instance: e86f76e1-8c60-48df-97a4-83e356392908] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Detaching volume: 060795e2-b587-4723-a4c0-36123108a1f7 {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 17 10:13:52 user nova-compute[73158]: INFO nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Detaching volume 060795e2-b587-4723-a4c0-36123108a1f7
Aug 17 10:13:52 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Skipping driver_detach during remote rebuild. {{(pid=73158) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG nova.objects.instance [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lazy-loading 'flavor' on Instance uuid 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:53 user nova-compute[73158]: INFO nova.compute.manager [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Attaching volume a09e5a6e-ef09-40ae-a5fc-876b94402bb8 to /dev/sdc
Aug 17 10:13:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e79c68-b302-45d2-9cc2-597117c5c2cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3dd95-ef3b-4d8e-8df4-bed6c10b49c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc01c62-5a42-40b4-8d47-7f996925d161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ce2a2-8b9e-4f8f-97a2-a744415cfb07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:53 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b957b-95c9-4b6c-80f1-bbc2015ad982]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updating existing volume attachment record: 391c1872-8746-4c27-ad63-edbac725bc27 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-47e170e3-7b63-44be-8371-face7fb3ac83 req-dfab05dc-4199-44f0-a4fc-f51c5dd03ca0 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-47e170e3-7b63-44be-8371-face7fb3ac83 req-dfab05dc-4199-44f0-a4fc-f51c5dd03ca0 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-47e170e3-7b63-44be-8371-face7fb3ac83 req-dfab05dc-4199-44f0-a4fc-f51c5dd03ca0 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-47e170e3-7b63-44be-8371-face7fb3ac83 req-dfab05dc-4199-44f0-a4fc-f51c5dd03ca0 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-47e170e3-7b63-44be-8371-face7fb3ac83 req-dfab05dc-4199-44f0-a4fc-f51c5dd03ca0 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:53 user nova-compute[73158]: WARNING nova.compute.manager [req-47e170e3-7b63-44be-8371-face7fb3ac83 req-dfab05dc-4199-44f0-a4fc-f51c5dd03ca0 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e for instance with vm_state building and task_state spawning.
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: WARNING nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Failed to detach volume: 060795e2-b587-4723-a4c0-36123108a1f7 due to 'NoneType' object has no attribute 'devices'
Aug 17 10:13:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Detaching volume: b07c90c8-cb6c-4bcc-9daa-35738d79ff1d {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 17 10:13:55 user nova-compute[73158]: INFO nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Detaching volume b07c90c8-cb6c-4bcc-9daa-35738d79ff1d
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'flavor' on Instance uuid c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Skipping driver_detach during remote rebuild. {{(pid=73158) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:55 user nova-compute[73158]: WARNING nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Failed to detach volume: b07c90c8-cb6c-4bcc-9daa-35738d79ff1d due to 'NoneType' object has no attribute 'devices'
Aug 17 10:13:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Detaching volume: 8554d612-f2af-4a3b-985a-9c13b7a04c2d {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 17 10:13:55 user nova-compute[73158]: INFO nova.compute.manager [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Detaching volume 8554d612-f2af-4a3b-985a-9c13b7a04c2d
Aug 17 10:13:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Attaching volume 515d7d2c-b680-4673-bbb0-12c0087cd608 to /dev/vdb
Aug 17 10:13:55 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] [instance: 70c7bb53-8a39-4f8c-af66-4376b9fdead6] Skipping driver_detach during remote rebuild. {{(pid=73158) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-201371ec-b1d4-41e4-ab7f-e05c2e7748b8 req-fc26e1a0-3d46-4e88-8487-6d43f4b04013 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING nova.compute.manager [req-82169496-d17c-450a-9e71-d55be4267a72 req-74700a16-2c9e-424c-9e8a-7d15a7ddd69a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 for instance with vm_state building and task_state spawning.
Aug 17 10:13:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG os_brick.utils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3ae03-790b-4c30-abe2-26555cfb4e59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bed66f-cdb0-4666-ba39-efe3311c031a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f68a4e-5ad5-4a8d-a44e-c630cd3ad3f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e43377-aba8-4769-8a1a-a21ad2e62184]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:13:56 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d1fd3-c2ae-4c8f-967f-0fbed4c77e90]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG os_brick.utils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating existing volume attachment record: baca950e-4203-47d4-8f41-05b8213681d3 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:13:56 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Deleted allocations for instance 70c7bb53-8a39-4f8c-af66-4376b9fdead6
Aug 17 10:13:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c459ff1b-ccd1-45db-a839-c73d054fbf1e tempest-TaggedBootDevicesTest_v242-1889903111 tempest-TaggedBootDevicesTest_v242-1889903111-project-member] Lock "70c7bb53-8a39-4f8c-af66-4376b9fdead6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267237.6650527, 0a009128-dfff-4daf-b52c-28c6a06020ea => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:13:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] VM Resumed (Lifecycle Event)
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:13:57 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance spawned successfully.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:13:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267237.665657, 0a009128-dfff-4daf-b52c-28c6a06020ea => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:13:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] VM Started (Lifecycle Event)
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:13:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-changed-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Refreshing instance network info cache due to event network-changed-077d1c5f-3245-4d5b-851a-740deb1acbd5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] Acquiring lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] Acquired lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.network.neutron [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Refreshing network info cache for port 077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:57 user nova-compute[73158]: WARNING nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 for instance with vm_state building and task_state spawning.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:57 user nova-compute[73158]: WARNING nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 for instance with vm_state building and task_state spawning.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:57 user nova-compute[73158]: WARNING nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 for instance with vm_state building and task_state spawning.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:13:57 user nova-compute[73158]: WARNING nova.compute.manager [req-41acd50d-863b-4861-8600-2ea639d92003 req-b718892c-d786-4479-9599-e38a4519b2cc service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 for instance with vm_state building and task_state spawning.
Aug 17 10:13:57 user nova-compute[73158]: INFO nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Took 11.37 seconds to spawn the instance on the hypervisor.
Aug 17 10:13:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:13:58 user nova-compute[73158]: INFO nova.compute.manager [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Took 65.39 seconds to build instance.
Aug 17 10:13:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34fa188a-0795-4478-80ba-dbe91cc890b1 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 65.496s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:13:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updated VIF entry in instance network info cache for port 077d1c5f-3245-4d5b-851a-740deb1acbd5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:13:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updating instance_info_cache with network_info: [{"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:13:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0542bdfb-63f1-403a-a09c-45e0c178ba27 req-db285fff-9300-4ee7-9c41-f7173731ef60 service nova] Releasing lock "refresh_cache-8775f432-db12-4e5f-b484-37a1922742a6" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:14:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVunAJFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:06 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:06 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:06 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38a779-d7b4-43e9-a895-9b43cd56859d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:14:06 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc0d46-0f3e-4225-bc7f-f811ce8bb9a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3] added
Aug 17 10:14:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa7ccb-6b10-4e92-a972-07a67fedc534]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7daeb0d-4dcb-4e0e-b5db-b9edbe6ab651]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVunAJFZ {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVunAJFZ" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d371c8f3-e789-454e-b616-3059afb0f1a7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EVunAJFZ'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70cc583-95f3-4b5d-bbc4-51879a0ab291]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c26ee1f-33e5-4b8b-8a2d-403ec803fa82]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bccaff0-30db-49a4-a526-716627067f94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260]
Aug 17 10:14:06 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac73cc5-64f5-4c9f-ae56-c63043d44b1c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb824ece-28e0-433d-bad8-a6c96f5caeed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdec4ec-9136-4fa6-9cd3-2b6bbc78bbeb]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVunAJFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lazy-loading 'flavor' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:07 user nova-compute[73158]: INFO nova.compute.manager [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Attaching volume 398770f6-e628-4598-a485-4306cd31199c to /dev/vdb
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.utils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ffeb75-d5ac-4a3f-885e-404480d127ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06411f8-ec91-401b-88e2-343a4709ad43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f5a63b-3b0d-4731-b11d-145bea21128d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfddb00c-686f-4d8f-8523-207842e575b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:07 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:14:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bffe5b-9d6c-4f64-8855-ba88db6d3377]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.utils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updating existing volume attachment record: 060b617e-7992-41ee-ac0e-34db4fdc5e12 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23532313831633064', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532313831633064', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lazy-loading 'flavor' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 10:14:07 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:07 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:14:07 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:07 user nova-compute[73158]:   <serial>c895d036-214c-4750-90d0-b55ca92ddec3</serial>
Aug 17 10:14:07 user nova-compute[73158]: </disk>
Aug 17 10:14:07 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:14:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] No VIF found with MAC fa:16:3e:3c:db:35, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqnoGpTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:09 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:09 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:09 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd5301e-0e94-4672-87ef-8c183f0b2f22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:14:09 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[686b7b7b-6559-4e92-b308-7fc1789cba31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608] added
Aug 17 10:14:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d6437b-302e-412c-8f6c-008648da3a52]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7eec66-8c28-40e2-bfb0-7b575e391647]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqnoGpTf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqnoGpTf" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07450e8-5bc6-468f-8c97-f60505f05c38]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WqnoGpTf'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5320080-0b62-4baf-81fe-35d12ced44f4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff686c8-6ca6-47b9-b0da-400edc60aeb9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2818bea-fce7-4a24-824b-3b40ce9e78fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260]
Aug 17 10:14:09 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-18881d0a-13b6-4615-b2d3-df95f8aacd38 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.369s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce5882-83d6-47a2-b6b4-7f00226c5ef1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[457aa6b5-44e0-49a7-803e-2a3b9c51861f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)
Aug 17 10:14:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d906ba0-5a15-4500-98da-d0376db8d159]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqnoGpTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] volume_snapshot_create: create_info: {'snapshot_id': '6281577e-b0ec-4da4-b2e6-3ba6056655f2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73158) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] snap xml: <domainsnapshot>
Aug 17 10:14:10 user nova-compute[73158]:   <disks>
Aug 17 10:14:10 user nova-compute[73158]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 17 10:14:10 user nova-compute[73158]:       <source file="/dev/new_file"/>
Aug 17 10:14:10 user nova-compute[73158]:     </disk>
Aug 17 10:14:10 user nova-compute[73158]:     <disk name="vda" snapshot="no"/>
Aug 17 10:14:10 user nova-compute[73158]:   </disks>
Aug 17 10:14:10 user nova-compute[73158]: </domainsnapshot>
Aug 17 10:14:10 user nova-compute[73158]:  {{(pid=73158) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lazy-loading 'system_metadata' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     rv = execute(f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     six.reraise(c, e, tb)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     raise value
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     rv = meth(*args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     self._volume_snapshot_create(context, instance, guest,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     rv = execute(f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     six.reraise(c, e, tb)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     raise value
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     rv = meth(*args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] 
Aug 17 10:14:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23339663135383663', 'path': '/dev/sdg'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339663135383663', 'path': '/dev/sdg'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-adb17dfe-c665-4cd4-a2dc-531db9525f39 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] volume_snapshot_delete: delete_info: {'volume_id': 'c895d036-214c-4750-90d0-b55ca92ddec3'} {{(pid=73158) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [None req-adb17dfe-c665-4cd4-a2dc-531db9525f39 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038]     if delete_info['type'] != 'qcow2':
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] KeyError: 'type'
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] 
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'flavor' on Instance uuid c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:14:10 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:10 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:14:10 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:10 user nova-compute[73158]:   <serial>515d7d2c-b680-4673-bbb0-12c0087cd608</serial>
Aug 17 10:14:10 user nova-compute[73158]: </disk>
Aug 17 10:14:10 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6281577e-b0ec-4da4-b2e6-3ba6056655f2 could not be found.
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6281577e-b0ec-4da4-b2e6-3ba6056655f2 could not be found. (HTTP 404) (Request-ID: req-82129a16-a158-4d88-8f6b-6a1636bc68bb)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6281577e-b0ec-4da4-b2e6-3ba6056655f2 could not be found.
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server [None req-0682d5c8-d989-478f-908f-b603affa06e3 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver [None req-adb17dfe-c665-4cd4-a2dc-531db9525f39 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-53c1fd96-6810-4478-b1a0-aacb8d74d982)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 10:14:10 user nova-compute[73158]: ERROR nova.virt.libvirt.driver 
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server [None req-adb17dfe-c665-4cd4-a2dc-531db9525f39 tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 10:14:10 user nova-compute[73158]: ERROR oslo_messaging.rpc.server 
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No VIF found with MAC fa:16:3e:f2:fc:29, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:11 user nova-compute[73158]: INFO nova.compute.manager [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Detaching volume c895d036-214c-4750-90d0-b55ca92ddec3
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3a2acedb-e175-42bb-b564-ad8f3b5d48b5 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.676s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:11 user nova-compute[73158]: INFO nova.virt.block_device [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Attempting to driver detach volume c895d036-214c-4750-90d0-b55ca92ddec3 from mountpoint /dev/vdb
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Attempting to detach device vdb from instance 4fe0d193-0f59-449a-89d1-e9445cad5038 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 10:14:11 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:11 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:14:11 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:11 user nova-compute[73158]:   <serial>c895d036-214c-4750-90d0-b55ca92ddec3</serial>
Aug 17 10:14:11 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:14:11 user nova-compute[73158]: </disk>
Aug 17 10:14:11 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:14:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Successfully detached device vdb from instance 4fe0d193-0f59-449a-89d1-e9445cad5038 from the persistent domain config.
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fe0d193-0f59-449a-89d1-e9445cad5038 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 10:14:11 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:11 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:14:11 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:11 user nova-compute[73158]:   <serial>c895d036-214c-4750-90d0-b55ca92ddec3</serial>
Aug 17 10:14:11 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:14:11 user nova-compute[73158]: </disk>
Aug 17 10:14:11 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267251.8737571, 4fe0d193-0f59-449a-89d1-e9445cad5038 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:14:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Successfully detached device vdb from instance 4fe0d193-0f59-449a-89d1-e9445cad5038 from the live domain config.
Aug 17 10:14:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVunAJFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:11 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7be2d1-886e-4627-a7ec-f5075aa0502c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135850c-72d6-44ee-84fb-52a556b7507d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)
Aug 17 10:14:11 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc426d9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8df4f9-166b-4ff3-bc11-96bb237162f2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f060492-3d69-4e83-a4ae-e55eec1c2730]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7e87a3-35b9-4469-8559-75bd2d011a28]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66256f05-83d2-4da7-aca5-30ec508cd7af]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a028c-860f-4cfa-8b4c-a1e3386898fe]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222af75-99af-49b6-9831-ddb5ac77b231]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260]
Aug 17 10:14:12 user nova-compute[73158]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c895d036-214c-4750-90d0-b55ca92ddec3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb57108f-c4bd-46b6-8692-32680590ea90]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] <== disconnect_volume: return (310ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:12 user nova-compute[73158]: INFO nova.compute.manager [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Detaching volume 515d7d2c-b680-4673-bbb0-12c0087cd608
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lazy-loading 'flavor' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5772de1c-5e6b-452d-a5e7-6ea35f6ab13b tempest-VolumesAssistedSnapshotsTest-463270544 tempest-VolumesAssistedSnapshotsTest-463270544-project-admin] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.959s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:13 user nova-compute[73158]: INFO nova.virt.block_device [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Attempting to driver detach volume 515d7d2c-b680-4673-bbb0-12c0087cd608 from mountpoint /dev/vdb
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Attempting to detach device vdb from instance c3b24204-badc-4d40-9b96-5a8b07a49250 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:14:13 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:13 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:14:13 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:13 user nova-compute[73158]:   <serial>515d7d2c-b680-4673-bbb0-12c0087cd608</serial>
Aug 17 10:14:13 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:14:13 user nova-compute[73158]: </disk>
Aug 17 10:14:13 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:14:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Successfully detached device vdb from instance c3b24204-badc-4d40-9b96-5a8b07a49250 from the persistent domain config.
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3b24204-badc-4d40-9b96-5a8b07a49250 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:14:13 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:13 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:14:13 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:13 user nova-compute[73158]:   <serial>515d7d2c-b680-4673-bbb0-12c0087cd608</serial>
Aug 17 10:14:13 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:14:13 user nova-compute[73158]: </disk>
Aug 17 10:14:13 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267253.8410275, c3b24204-badc-4d40-9b96-5a8b07a49250 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:14:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Successfully detached device vdb from instance c3b24204-badc-4d40-9b96-5a8b07a49250 from the live domain config.
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqnoGpTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:13 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4a7eaf-76d5-4415-8e4a-e347b3a524b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[548cff36-9f63-4a1c-b654-c983a095fb54]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 (non-flash)
Aug 17 10:14:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3f3d3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608'): ({'sdg'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Removing single pathed devices sdg {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faad981-62ea-4a32-8e98-bd5e7f07cd56]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc40e8-12c8-4598-be8a-f64c27033bc9]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Flushing IO for device /dev/sdg {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-changed-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Refreshing instance network info cache due to event network-changed-6f21dff0-22a2-431e-ab50-33b7956a0a5f. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] Acquiring lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] Acquired lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Refreshing network info cache for port 6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26299125-c413-4b90-9b69-2e40558b177d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e44f6-c890-4d5f-8a2a-1092113fa96c]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb722bc-f092-47c9-bcad-30d7e687e7dd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e7683-67ac-45e7-bdd0-c1fd06e03e43]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260]
Aug 17 10:14:14 user nova-compute[73158]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515d7d2c-b680-4673-bbb0-12c0087cd608 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b40a69-a600-4f89-9a09-6df6877d4421]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] <== disconnect_volume: return (329ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:14:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updated VIF entry in instance network info cache for port 6f21dff0-22a2-431e-ab50-33b7956a0a5f. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:14:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating instance_info_cache with network_info: [{"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:14:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bf9c89f2-f6fb-4cc0-a868-77e83177af98 req-988b80a0-0f83-4d51-9a93-92941758de8e service nova] Releasing lock "refresh_cache-f877b207-950b-4c69-9e6b-29e973f97a0f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:14:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'flavor' on Instance uuid c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae819c01-dccf-4b01-8c03-8801cdc4f798 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.065s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:16 user nova-compute[73158]: INFO nova.compute.manager [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Rebuilding instance
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'trusted_certs' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'pci_requests' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'pci_devices' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'resources' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'migration_context' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73158) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODqbZkdU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:16 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:16 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:16 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943e154-9af7-470c-b51e-db1f485c1d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:14:16 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7003c4e7-e06b-4bcc-81cc-5673487e8b2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8] added
Aug 17 10:14:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b10c8e-5536-459a-8c23-cb627ea94390]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4468a014-33c6-4beb-b068-6a6c3f84a6d0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODqbZkdU {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODqbZkdU" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a57a319-f1e2-4053-9572-a9178f39fa29]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ODqbZkdU'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a8280d-8219-4267-86fe-1346e7ae6ccd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd34cf32-593b-4afe-9eb1-6d3c0ad88c01]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2aef70-abd7-4a1b-b658-6ea71f4d07b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260]
Aug 17 10:14:16 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-5985975f-dc8f-470d-980d-bb773fbef545 req-3361093b-0533-40ba-a10b-e55ce3362f3b service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-unplugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5985975f-dc8f-470d-980d-bb773fbef545 req-3361093b-0533-40ba-a10b-e55ce3362f3b service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5985975f-dc8f-470d-980d-bb773fbef545 req-3361093b-0533-40ba-a10b-e55ce3362f3b service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5985975f-dc8f-470d-980d-bb773fbef545 req-3361093b-0533-40ba-a10b-e55ce3362f3b service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-5985975f-dc8f-470d-980d-bb773fbef545 req-3361093b-0533-40ba-a10b-e55ce3362f3b service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-unplugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:14:16 user nova-compute[73158]: WARNING nova.compute.manager [req-5985975f-dc8f-470d-980d-bb773fbef545 req-3361093b-0533-40ba-a10b-e55ce3362f3b service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-unplugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state active and task_state rebuilding.
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[703c9085-e17f-44a9-b863-79fa210517f4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3758377-5fcc-4597-91a4-a424ac051bab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab6653-bd3f-4c17-bb9a-1cd933c89819]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:16 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance destroyed successfully.
Aug 17 10:14:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance destroyed successfully.
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-469509928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1830998465',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp13s87YsSP5hXLXc3oT8gJDyNrfg0qxxuhSOTIUV/wq7nkQKQpqWZkXMVscmA9MWfKqzW6Zzzyd6dWMztqDvVyV/bCj1V6/KYCJfxNHY0Rts1QnrfR7feMD/5zrB3fOQ==',key_name='tempest-keypair-1685511148',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85c1113c081e46ada5ee3a9ca5004d15',ramdisk_id='',reservation_id='r-jbslfto5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1012743389',owner_user_name='tempest-ServerActionsV293TestJSON-1012743389-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d84e880a3e2f4707b3d58e353281fbd0',uuid=f877b207-950b-4c69-9e6b-29e973f97a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converting VIF {"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f21dff0-22, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:17 user nova-compute[73158]: INFO os_vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22')
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:17 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODqbZkdU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23765326538346463', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765326538346463', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.574s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.objects.instance [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lazy-loading 'flavor' on Instance uuid 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591a630-6525-4afe-bd8f-966c525be49f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:14:17 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:17 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:14:17 user nova-compute[73158]:   <target dev="sdc" bus="scsi"/>
Aug 17 10:14:17 user nova-compute[73158]:   <serial>a09e5a6e-ef09-40ae-a5fc-876b94402bb8</serial>
Aug 17 10:14:17 user nova-compute[73158]:   <address type="drive" controller="0" unit="2"/>
Aug 17 10:14:17 user nova-compute[73158]: </disk>
Aug 17 10:14:17 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[18551209-9f7c-4aeb-8543-a65ce439df14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3421d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc38301-76a4-4d55-8e68-bee6b9e22e06]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[244110ed-2c73-492d-9e19-d3720db3d440]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a585a0-3b66-40ab-a5d9-3c5a57f3ca1a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:14:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a4a8e-3e30-4f51-8563-d05a922ff666]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbf36c9-3d7e-4cb6-a39f-368b9b200352]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a851949f-6578-4a5d-8728-6ab8fef341e3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]
Aug 17 10:14:18 user nova-compute[73158]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ea707-e3b8-41a0-933f-e97d401a6a6e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== disconnect_volume: return (899ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:14:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Deleting instance files /opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f_del
Aug 17 10:14:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Deletion of /opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f_del complete
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f877b207-950b-4c69-9e6b-29e973f97a0f could not be found.
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:18 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b592afe-7961-4374-b388-492b2a0c7679]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No BDM found with device name sda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] No VIF found with MAC fa:16:3e:f3:9f:0a, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a3eaf-dac2-4deb-8fbf-ac1641c7697e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:18 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:18 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:18 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:18 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:18 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:18 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3410fbe0>, {}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Disconnecting from: [] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== disconnect_volume: return (73ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-65c5d38b-7d4f-4b4a-a9c6-a1655a1c044d tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.675s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-f59db60c-482e-4d55-95fd-1d45b9396a51 req-e5c22cba-d56d-4b22-b172-9c441c22754e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f59db60c-482e-4d55-95fd-1d45b9396a51 req-e5c22cba-d56d-4b22-b172-9c441c22754e service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f59db60c-482e-4d55-95fd-1d45b9396a51 req-e5c22cba-d56d-4b22-b172-9c441c22754e service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f59db60c-482e-4d55-95fd-1d45b9396a51 req-e5c22cba-d56d-4b22-b172-9c441c22754e service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-f59db60c-482e-4d55-95fd-1d45b9396a51 req-e5c22cba-d56d-4b22-b172-9c441c22754e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:14:18 user nova-compute[73158]: WARNING nova.compute.manager [req-f59db60c-482e-4d55-95fd-1d45b9396a51 req-e5c22cba-d56d-4b22-b172-9c441c22754e service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state active and task_state rebuilding.
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:19 user nova-compute[73158]: INFO nova.compute.manager [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Detaching volume a09e5a6e-ef09-40ae-a5fc-876b94402bb8
Aug 17 10:14:19 user nova-compute[73158]: INFO nova.virt.block_device [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Attempting to driver detach volume a09e5a6e-ef09-40ae-a5fc-876b94402bb8 from mountpoint /dev/sdc
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Attempting to detach device sdc from instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:14:19 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:19 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:14:19 user nova-compute[73158]:   <target dev="sdc" bus="scsi"/>
Aug 17 10:14:19 user nova-compute[73158]:   <serial>a09e5a6e-ef09-40ae-a5fc-876b94402bb8</serial>
Aug 17 10:14:19 user nova-compute[73158]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 10:14:19 user nova-compute[73158]: </disk>
Aug 17 10:14:19 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:14:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Successfully detached device sdc from instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 from the persistent domain config.
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:14:19 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:19 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:14:19 user nova-compute[73158]:   <target dev="sdc" bus="scsi"/>
Aug 17 10:14:19 user nova-compute[73158]:   <serial>a09e5a6e-ef09-40ae-a5fc-876b94402bb8</serial>
Aug 17 10:14:19 user nova-compute[73158]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 10:14:19 user nova-compute[73158]: </disk>
Aug 17 10:14:19 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267259.722514, 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:14:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Successfully detached device sdc from instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 from the live domain config.
Aug 17 10:14:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODqbZkdU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:19 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[374cad2f-9704-41c6-b4c4-c23b359ce6f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb350504-c609-4450-aa1e-3b61435ec146]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:19 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:19 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:19 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:19 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:19 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:19 user nova-compute[73158]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 (non-flash)
Aug 17 10:14:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c47dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d338d2ce-1027-4a4e-bd03-4d1c773cb7a0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716611c-614e-4e9e-91f6-8d77a48b30c4]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a2e7e8-dc4a-433f-a82c-671ea9657f52]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f337d21e-3cf3-4729-b696-b67a87a06739]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc10923-666e-4e2f-9db5-1461eeaf65f6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34704195-5ca5-4c94-9cf2-7a79ac99adfd]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260]
Aug 17 10:14:20 user nova-compute[73158]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:20 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a09e5a6e-ef09-40ae-a5fc-876b94402bb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e6111-3bd7-4b27-b804-8f4fe719f6c4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] <== disconnect_volume: return (306ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG nova.objects.instance [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lazy-loading 'flavor' on Instance uuid 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-21c402bb-713d-4e81-832d-68212db00f48 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:23 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:14:23 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:14:23 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7340MB free_disk=24.634735107421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:14:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe0d193-0f59-449a-89d1-e9445cad5038 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c3b24204-badc-4d40-9b96-5a8b07a49250 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8775f432-db12-4e5f-b484-37a1922742a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f877b207-950b-4c69-9e6b-29e973f97a0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 0a009128-dfff-4daf-b52c-28c6a06020ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:14:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Preparing to wait for external event volume-reimaged-e8947c30-7d7a-4fa1-a4d6-21bab03655a0 {{(pid=73158) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:28 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:28 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:28 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f0fb0-5d44-4c39-a0c2-32c7ad1593df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:14:28 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25337c-fcad-4eba-8000-ee554a56ffc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c] added
Aug 17 10:14:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb25ab4-43bb-4270-8247-be27f5ecdac3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25bf97a-d56e-4e1d-9df7-160fc17d30da]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnNchMvY {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnNchMvY" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[45925fba-8768-4073-8b72-f3ec3f6171a3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnNchMvY'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe1f0d3-93f7-4cf3-8d98-dcbfccd136d3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8819b9-a6aa-44a8-aeb1-f127dcf0f183]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5412abf4-52a1-4223-90bd-51fb094d0552]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]
Aug 17 10:14:28 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd2f23-3130-4575-a46a-4ccf0af1cad9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6424b191-3338-4491-8f39-f6db282fe758]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:28 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:14:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1a1e1e-db0d-43aa-826f-5a585efba8b8]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26532363836643333', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363836643333', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lazy-loading 'flavor' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:14:30 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:14:30 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:14:30 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:14:30 user nova-compute[73158]:   <serial>398770f6-e628-4598-a485-4306cd31199c</serial>
Aug 17 10:14:30 user nova-compute[73158]: </disk>
Aug 17 10:14:30 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] No VIF found with MAC fa:16:3e:4f:6f:bd, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:14:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9156645e-3f16-4f1f-999b-740626e3f295 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.793s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267257.2018018, f877b207-950b-4c69-9e6b-29e973f97a0f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:14:32 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] VM Stopped (Lifecycle Event)
Aug 17 10:14:32 user nova-compute[73158]: DEBUG os_brick.utils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a55499e8-1e0b-4546-966a-241689b98ff8 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae02870-3823-4f08-bd37-a0462d053c65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191c822-e954-4318-ac6c-afbee5e17cca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[354973f8-5e9a-47a1-87de-cd122388eb14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a248ae-d315-469f-886e-73c0d7edd0bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:32 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:14:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e56e790-dfe7-48bf-b73e-e160bac7bf43]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:14:32 user nova-compute[73158]: DEBUG os_brick.utils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:32 user nova-compute[73158]: INFO nova.compute.manager [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Swapping volume 398770f6-e628-4598-a485-4306cd31199c for 6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3
Aug 17 10:14:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSoghsku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8775f432-db12-4e5f-b484-37a1922742a6', 'attached_at': '', 'detached_at': '', 'volume_id': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3', 'serial': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8775f432-db12-4e5f-b484-37a1922742a6', 'attached_at': '', 'detached_at': '', 'volume_id': '398770f6-e628-4598-a485-4306cd31199c', 'serial'} {{(pid=73158) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSoghsku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:44 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:44 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:44 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[29676904-0aaf-49dc-aa0f-5e0c85cded94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:14:44 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29857be-7c29-4a03-8181-6245efac02e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3] added
Aug 17 10:14:44 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[955edad6-b814-40fa-87a7-5c5ca9e9055c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[77246b30-e326-45e4-9a8f-67ae57502c85]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSoghsku {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSoghsku" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd1ad1-6d2e-47f5-a8f7-c7d8d340596a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSoghsku'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3ea6a-532b-478d-8b90-8c382336224a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c187fd-7e88-44c8-aae2-28bd0ab987f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[933b9a1d-533d-42c5-bb61-9568f86efaef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260]
Aug 17 10:14:44 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:44 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad532db-8655-4225-a15e-38ce84408d19]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21f440-b916-47b5-9d4d-e2cc9eefb147]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:44 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:44 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:14:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02657c0-dc51-4935-b311-d6af0c5b153c]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:45 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSoghsku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23931626264663337', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931626264663337', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lazy-loading 'flavor' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 313524224 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 470810624 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 605028352 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 729808896 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 818937856 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:50 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ce304-a78c-4ac5-969d-402468457e4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d486e9-0416-42d2-9739-0f326fb186d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:14:50 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:14:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[08814e3c-61c2-42f4-b421-7f2977b491da]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5a58e2-ad77-4816-bae5-58be52c0df98]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f68435-4d33-4ceb-8ff4-48aaa1917aca]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e522e30-bffb-495a-98ad-3d136ee3ab05]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa8e85-c460-49dc-bf2d-e8cce9e5fb28]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6404086-ee18-455a-86ff-b973751bab55]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]
Aug 17 10:14:51 user nova-compute[73158]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.
Aug 17 10:14:51 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2840a09a-d22d-484c-b764-34b2d314cd29]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] <== disconnect_volume: return (339ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSoghsku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '8775f432-db12-4e5f-b484-37a1922742a6', 'attached_at': '', 'detached_at': '', 'volume_id': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3', 'serial'} {{(pid=73158) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 10:14:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] swap_volume: removing Cinder connection for volume 398770f6-e628-4598-a485-4306cd31199c {{(pid=73158) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 10:14:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] swap_volume: Updating volume 398770f6-e628-4598-a485-4306cd31199c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "PSoghsku", "auth_password": "qzVTcBnUNRLZM1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3"}, "status": "reserved", "instance": "8775f432-db12-4e5f-b484-37a1922742a6", "attached_at": "", "detached_at": "", "volume_id": "6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3", "serial": "6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3', 'no_device': None, 'attachment_id': '61b82885-426e-4ed8-a28b-2f062b56a44a'} {{(pid=73158) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 10:14:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-34d6abab-bb9d-4acf-ad04-6123d1d4d7a5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.836s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[011730fd-c100-4214-81bf-fbc3b9706881]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe99a0-2f63-4fcd-83b6-8cd0578eef75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ad5e2-9844-4590-b1c6-13f73cc4cd4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4423c75-7793-40dc-a506-28e08b107201]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:53 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:14:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[796b57b6-9b3a-4670-a7ad-eaa7a276c1c5]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:14:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:53 user nova-compute[73158]: INFO nova.compute.manager [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Swapping volume 6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 for 398770f6-e628-4598-a485-4306cd31199c
Aug 17 10:14:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-be5f063d-568c-4f81-b408-aec7bd89e99b req-d2180756-2eb8-42a2-9d8b-d5760d74bbc4 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event volume-reimaged-e8947c30-7d7a-4fa1-a4d6-21bab03655a0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-be5f063d-568c-4f81-b408-aec7bd89e99b req-d2180756-2eb8-42a2-9d8b-d5760d74bbc4 service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-be5f063d-568c-4f81-b408-aec7bd89e99b req-d2180756-2eb8-42a2-9d8b-d5760d74bbc4 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-be5f063d-568c-4f81-b408-aec7bd89e99b req-d2180756-2eb8-42a2-9d8b-d5760d74bbc4 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-be5f063d-568c-4f81-b408-aec7bd89e99b req-d2180756-2eb8-42a2-9d8b-d5760d74bbc4 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Processing event volume-reimaged-e8947c30-7d7a-4fa1-a4d6-21bab03655a0 {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance event wait completed in 29 seconds for volume-reimaged {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:14:58 user nova-compute[73158]: INFO nova.virt.block_device [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Booting with volume e8947c30-7d7a-4fa1-a4d6-21bab03655a0 at /dev/vda
Aug 17 10:14:58 user nova-compute[73158]: DEBUG os_brick.utils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597d914-9267-4cda-bfe8-4437c8aec5a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6533d2e5-11d6-489f-880b-4e20bd319bbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34663c45-63e9-4e73-be3b-19649575f2e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac83253-1906-4392-90e0-2bcd155c00d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:14:58 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:14:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f92c4bb-2e42-4291-acb2-64eaa0491cd1]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG os_brick.utils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:14:58 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating existing volume attachment record: 8e3243bb-8886-4cfc-8315-b56882b54ca0 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:15:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "d2cf001d-2354-463a-8683-e023222bfc9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:15:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:03 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:15:03 user nova-compute[73158]: INFO nova.compute.claims [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Claim successful on node user
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:15:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.policy [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8cdcc95e0854d68a15db4d7e3d998e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3a5e2269964313aa7a3a3d4d2e604f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:15:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Creating image(s)
Aug 17 10:15:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "/opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "/opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.211s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk 1073741824" returned: 0 in 0.058s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Cannot resize image /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'migration_context' on Instance uuid d2cf001d-2354-463a-8683-e023222bfc9b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Ensure instance console log exists: /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Successfully created port: 2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Successfully updated port: 2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "refresh_cache-d2cf001d-2354-463a-8683-e023222bfc9b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquired lock "refresh_cache-d2cf001d-2354-463a-8683-e023222bfc9b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-changed-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Refreshing instance network info cache due to event network-changed-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] Acquiring lock "refresh_cache-d2cf001d-2354-463a-8683-e023222bfc9b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8775f432-db12-4e5f-b484-37a1922742a6', 'attached_at': '', 'detached_at': '', 'volume_id': '398770f6-e628-4598-a485-4306cd31199c', 'serial': '398770f6-e628-4598-a485-4306cd31199c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSoghsku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'}, 'status': 'reserved', 'instance': '8775f432-db12-4e5f-b484-37a1922742a6', 'attached_at': '', 'detached_at': '', 'volume_id': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3', 'serial'} {{(pid=73158) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:07 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:07 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:07 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9854719-61a7-436f-8758-a51c3afaf18a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:15:07 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2eb4da-67d5-489a-b482-e5707426c419]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c] added
Aug 17 10:15:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be591a-07b4-4e63-b9c5-a23142cc2cfb]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b479acc-ced7-4809-a84d-058fc974aae8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnNchMvY {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnNchMvY" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e43baa1-24ae-40a3-9fb1-49a0a390c46b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnNchMvY'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9fa74-3e1b-4dcd-9293-c947e941a9a2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Updating instance_info_cache with network_info: [{"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f64c6e-b464-4cc9-b8ac-e224bdbcc09b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Releasing lock "refresh_cache-d2cf001d-2354-463a-8683-e023222bfc9b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Instance network_info: |[{"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:07 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:07 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:07 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:07 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:07 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:07 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] Acquired lock "refresh_cache-d2cf001d-2354-463a-8683-e023222bfc9b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Refreshing network info cache for port 2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Start _get_guest_xml network_info=[{"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:07 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:07 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:15:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1316682167',display_name='tempest-VolumesAdminNegativeTest-server-1316682167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1316682167',id=12,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3a5e2269964313aa7a3a3d4d2e604f',ramdisk_id='',reservation_id='r-mxmepv4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1264923804',owner_user_name='tempest-VolumesAdminNegativeTest-1264923804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:05Z,user_data=None,user_id='a8cdcc95e0854d68a15db4d7e3d998e5',uuid=d2cf001d-2354-463a-8683-e023222bfc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converting VIF {"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'pci_devices' on Instance uuid d2cf001d-2354-463a-8683-e023222bfc9b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d267b9f-464d-4460-a826-2c7a33e7878e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]
Aug 17 10:15:08 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:08 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:15:08 user nova-compute[73158]:   <uuid>d2cf001d-2354-463a-8683-e023222bfc9b</uuid>
Aug 17 10:15:08 user nova-compute[73158]:   <name>instance-0000000c</name>
Aug 17 10:15:08 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:15:08 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:15:08 user nova-compute[73158]:   <metadata>
Aug 17 10:15:08 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:15:08 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:15:08 user nova-compute[73158]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1316682167</nova:name>
Aug 17 10:15:08 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:15:07</nova:creationTime>
Aug 17 10:15:08 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:15:08 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:15:08 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:15:08 user nova-compute[73158]:       <nova:owner>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:user uuid="a8cdcc95e0854d68a15db4d7e3d998e5">tempest-VolumesAdminNegativeTest-1264923804-project-member</nova:user>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:project uuid="cc3a5e2269964313aa7a3a3d4d2e604f">tempest-VolumesAdminNegativeTest-1264923804</nova:project>
Aug 17 10:15:08 user nova-compute[73158]:       </nova:owner>
Aug 17 10:15:08 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:15:08 user nova-compute[73158]:       <nova:ports>
Aug 17 10:15:08 user nova-compute[73158]:         <nova:port uuid="2b675d5a-b9f0-4235-8ef0-be54ff9bfb84">
Aug 17 10:15:08 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:15:08 user nova-compute[73158]:         </nova:port>
Aug 17 10:15:08 user nova-compute[73158]:       </nova:ports>
Aug 17 10:15:08 user nova-compute[73158]:     </nova:instance>
Aug 17 10:15:08 user nova-compute[73158]:   </metadata>
Aug 17 10:15:08 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:15:08 user nova-compute[73158]:     <system>
Aug 17 10:15:08 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:15:08 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:15:08 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:15:08 user nova-compute[73158]:       <entry name="serial">d2cf001d-2354-463a-8683-e023222bfc9b</entry>
Aug 17 10:15:08 user nova-compute[73158]:       <entry name="uuid">d2cf001d-2354-463a-8683-e023222bfc9b</entry>
Aug 17 10:15:08 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:15:08 user nova-compute[73158]:     </system>
Aug 17 10:15:08 user nova-compute[73158]:   </sysinfo>
Aug 17 10:15:08 user nova-compute[73158]:   <os>
Aug 17 10:15:08 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:15:08 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:15:08 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:15:08 user nova-compute[73158]:   </os>
Aug 17 10:15:08 user nova-compute[73158]:   <features>
Aug 17 10:15:08 user nova-compute[73158]:     <acpi/>
Aug 17 10:15:08 user nova-compute[73158]:     <apic/>
Aug 17 10:15:08 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:15:08 user nova-compute[73158]:   </features>
Aug 17 10:15:08 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:15:08 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:15:08 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:15:08 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:15:08 user nova-compute[73158]:   </clock>
Aug 17 10:15:08 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:15:08 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:15:08 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:15:08 user nova-compute[73158]:   </cpu>
Aug 17 10:15:08 user nova-compute[73158]:   <devices>
Aug 17 10:15:08 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:15:08 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:15:08 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk"/>
Aug 17 10:15:08 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:15:08 user nova-compute[73158]:     </disk>
Aug 17 10:15:08 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:15:08 user nova-compute[73158]:       <mac address="fa:16:3e:5e:ba:80"/>
Aug 17 10:15:08 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:08 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:15:08 user nova-compute[73158]:       <target dev="tap2b675d5a-b9"/>
Aug 17 10:15:08 user nova-compute[73158]:     </interface>
Aug 17 10:15:08 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:15:08 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/console.log" append="off"/>
Aug 17 10:15:08 user nova-compute[73158]:     </serial>
Aug 17 10:15:08 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:15:08 user nova-compute[73158]:     <video>
Aug 17 10:15:08 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:08 user nova-compute[73158]:     </video>
Aug 17 10:15:08 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:15:08 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:15:08 user nova-compute[73158]:     </rng>
Aug 17 10:15:08 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:15:08 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:15:08 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:15:08 user nova-compute[73158]:     </memballoon>
Aug 17 10:15:08 user nova-compute[73158]:   </devices>
Aug 17 10:15:08 user nova-compute[73158]: </domain>
Aug 17 10:15:08 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1316682167',display_name='tempest-VolumesAdminNegativeTest-server-1316682167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1316682167',id=12,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3a5e2269964313aa7a3a3d4d2e604f',ramdisk_id='',reservation_id='r-mxmepv4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1264923804',owner_user_name='tempest-VolumesAdminNegativeTest-1264923804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:05Z,user_data=None,user_id='a8cdcc95e0854d68a15db4d7e3d998e5',uuid=d2cf001d-2354-463a-8683-e023222bfc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converting VIF {"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_vif [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b675d5a-b9, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b675d5a-b9, col_values=(('external_ids', {'iface-id': '2b675d5a-b9f0-4235-8ef0-be54ff9bfb84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:ba:80', 'vm-uuid': 'd2cf001d-2354-463a-8683-e023222bfc9b'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8403f7a7-39b7-46dc-b511-f19c90830c08]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: INFO os_vif [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9')
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad1a52-7969-4ef8-87c8-63c44a46250a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:08 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:08 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:08 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[48095ecb-3f42-4af3-80d2-580270b4fe7a]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] No VIF found with MAC fa:16:3e:5e:ba:80, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:08 user nova-compute[73158]: INFO nova.compute.manager [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Terminating instance
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Updated VIF entry in instance network info cache for port 2b675d5a-b9f0-4235-8ef0-be54ff9bfb84. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Updating instance_info_cache with network_info: [{"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d3f75bd3-5296-49dc-8d07-1af0a2819337 req-9249bb9f-be37-42e7-b781-ba26ecfe4de0 service nova] Releasing lock "refresh_cache-d2cf001d-2354-463a-8683-e023222bfc9b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-f71754cb-4b6b-4bee-ad92-dfe8cf775a64 req-cc3af499-2437-4dd7-bcbc-bfc92c8d36e4 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-vif-unplugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f71754cb-4b6b-4bee-ad92-dfe8cf775a64 req-cc3af499-2437-4dd7-bcbc-bfc92c8d36e4 service nova] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f71754cb-4b6b-4bee-ad92-dfe8cf775a64 req-cc3af499-2437-4dd7-bcbc-bfc92c8d36e4 service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f71754cb-4b6b-4bee-ad92-dfe8cf775a64 req-cc3af499-2437-4dd7-bcbc-bfc92c8d36e4 service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-f71754cb-4b6b-4bee-ad92-dfe8cf775a64 req-cc3af499-2437-4dd7-bcbc-bfc92c8d36e4 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] No waiting events found dispatching network-vif-unplugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-f71754cb-4b6b-4bee-ad92-dfe8cf775a64 req-cc3af499-2437-4dd7-bcbc-bfc92c8d36e4 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-vif-unplugged-43982739-d0ed-4ec8-9576-31879af40e8a for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26532363836643333', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363836643333', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lazy-loading 'flavor' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:09 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Instance destroyed successfully.
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lazy-loading 'resources' on Instance uuid 4fe0d193-0f59-449a-89d1-e9445cad5038 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1642266553',display_name='tempest-VolumesAssistedSnapshotsTest-server-1642266553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1642266553',id=6,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzHO1nuHo9Gu0sTJgsRlanhpH1L24rlfx+wLjffAAYaBGTLeP/n7hWV07O/IW3/0GztbaRU+QXlz3Je0hEyuyrXhA4C9VUFQ2g2yDPu6mvi4nMv6V7NxMwMNaA9aavlVw==',key_name='tempest-keypair-1288337486',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a8c4fe0cb9440eb9f53959fb55ee44a',ramdisk_id='',reservation_id='r-47jbzrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-547804155',owner_user_name='tempest-VolumesAssistedSnapshotsTest-547804155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67894181ef514eb48b67fafdacebfbbc',uuid=4fe0d193-0f59-449a-89d1-e9445cad5038,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Converting VIF {"id": "43982739-d0ed-4ec8-9576-31879af40e8a", "address": "fa:16:3e:3c:db:35", "network": {"id": "408c922d-7973-4400-b59d-27ccdecda0f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-345195535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8c4fe0cb9440eb9f53959fb55ee44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43982739-d0", "ovs_interfaceid": "43982739-d0ed-4ec8-9576-31879af40e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:09 user nova-compute[73158]: DEBUG os_vif [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43982739-d0, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:10 user nova-compute[73158]: INFO os_vif [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:db:35,bridge_name='br-int',has_traffic_filtering=True,id=43982739-d0ed-4ec8-9576-31879af40e8a,network=Network(408c922d-7973-4400-b59d-27ccdecda0f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43982739-d0')
Aug 17 10:15:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Deleting instance files /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038_del
Aug 17 10:15:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Deletion of /opt/stack/data/nova/instances/4fe0d193-0f59-449a-89d1-e9445cad5038_del complete
Aug 17 10:15:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 18874368 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:10 user nova-compute[73158]: INFO nova.compute.manager [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Took 1.70 seconds to destroy the instance on the hypervisor.
Aug 17 10:15:10 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 161480704 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 275775488 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e856f60-d4f8-4038-81ec-6935f8edca77 req-bb8f6bd7-9f93-4dfe-95b5-0d7ba97d6d2a service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e856f60-d4f8-4038-81ec-6935f8edca77 req-bb8f6bd7-9f93-4dfe-95b5-0d7ba97d6d2a service nova] Acquiring lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e856f60-d4f8-4038-81ec-6935f8edca77 req-bb8f6bd7-9f93-4dfe-95b5-0d7ba97d6d2a service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e856f60-d4f8-4038-81ec-6935f8edca77 req-bb8f6bd7-9f93-4dfe-95b5-0d7ba97d6d2a service nova] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e856f60-d4f8-4038-81ec-6935f8edca77 req-bb8f6bd7-9f93-4dfe-95b5-0d7ba97d6d2a service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] No waiting events found dispatching network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:11 user nova-compute[73158]: WARNING nova.compute.manager [req-1e856f60-d4f8-4038-81ec-6935f8edca77 req-bb8f6bd7-9f93-4dfe-95b5-0d7ba97d6d2a service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received unexpected event network-vif-plugged-43982739-d0ed-4ec8-9576-31879af40e8a for instance with vm_state active and task_state deleting.
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-90c76623-990b-462c-b8e3-8a6167ed9b45 req-194d2e9c-c555-4290-a3bf-a39e764d18a7 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-90c76623-990b-462c-b8e3-8a6167ed9b45 req-194d2e9c-c555-4290-a3bf-a39e764d18a7 service nova] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-90c76623-990b-462c-b8e3-8a6167ed9b45 req-194d2e9c-c555-4290-a3bf-a39e764d18a7 service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-90c76623-990b-462c-b8e3-8a6167ed9b45 req-194d2e9c-c555-4290-a3bf-a39e764d18a7 service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-90c76623-990b-462c-b8e3-8a6167ed9b45 req-194d2e9c-c555-4290-a3bf-a39e764d18a7 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] No waiting events found dispatching network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:11 user nova-compute[73158]: WARNING nova.compute.manager [req-90c76623-990b-462c-b8e3-8a6167ed9b45 req-194d2e9c-c555-4290-a3bf-a39e764d18a7 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received unexpected event network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 for instance with vm_state building and task_state spawning.
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 407896064 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:11 user nova-compute[73158]: INFO nova.compute.manager [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Terminating instance
Aug 17 10:15:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 510656512 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-b7f54451-0d67-42d8-8727-79a2e8b0e9cb req-27c164af-6ceb-421d-9002-12a38f9e5782 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-vif-unplugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b7f54451-0d67-42d8-8727-79a2e8b0e9cb req-27c164af-6ceb-421d-9002-12a38f9e5782 service nova] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b7f54451-0d67-42d8-8727-79a2e8b0e9cb req-27c164af-6ceb-421d-9002-12a38f9e5782 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b7f54451-0d67-42d8-8727-79a2e8b0e9cb req-27c164af-6ceb-421d-9002-12a38f9e5782 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-b7f54451-0d67-42d8-8727-79a2e8b0e9cb req-27c164af-6ceb-421d-9002-12a38f9e5782 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] No waiting events found dispatching network-vif-unplugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-b7f54451-0d67-42d8-8727-79a2e8b0e9cb req-27c164af-6ceb-421d-9002-12a38f9e5782 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-vif-unplugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:12 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Took 2.17 seconds to deallocate network for instance.
Aug 17 10:15:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 665845760 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Instance destroyed successfully.
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.objects.instance [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lazy-loading 'resources' on Instance uuid 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1953341085',display_name='tempest-AttachSCSIVolumeTestJSON-server-1953341085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1953341085',id=5,image_ref='c312ade9-af9a-4899-a2ad-c684c29aee7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg3J3p/ZKa9m7MJdUHWBqq/Yqee3a/EPSyTvvoU3b+6Dti39g/X6Dac435A7BKRFdbJ03RMBFxtUYVR4xS1E5ukCwPSE1HBID4ETNpKBwXiogzg6E3Gz8yuqcDN4bDWGw==',key_name='tempest-keypair-1884051300',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb4ba6e407134d289cdc98e0ff892230',ramdisk_id='',reservation_id='r-kkntuat6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c312ade9-af9a-4899-a2ad-c684c29aee7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1442195416',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1442195416-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:12:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9c1836963bd4a2a8af1f5feed7eced3',uuid=6e23eb52-c52f-4ae4-912c-f7d517ba78a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Converting VIF {"id": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "address": "fa:16:3e:f3:9f:0a", "network": {"id": "3accdcff-fb91-4992-8e34-a1b651555be9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-915900293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb4ba6e407134d289cdc98e0ff892230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401613bc-ae", "ovs_interfaceid": "401613bc-ae59-486b-9aa8-ef866b1dc8d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG os_vif [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap401613bc-ae, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:12 user nova-compute[73158]: INFO os_vif [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:9f:0a,bridge_name='br-int',has_traffic_filtering=True,id=401613bc-ae59-486b-9aa8-ef866b1dc8d7,network=Network(3accdcff-fb91-4992-8e34-a1b651555be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401613bc-ae')
Aug 17 10:15:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Deleting instance files /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4_del
Aug 17 10:15:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Deletion of /opt/stack/data/nova/instances/6e23eb52-c52f-4ae4-912c-f7d517ba78a4_del complete
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Creating image(s)
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Ensure instance console log exists: /opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Start _get_guest_xml network_info=[{"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '8e3243bb-8886-4cfc-8315-b56882b54ca0', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f877b207-950b-4c69-9e6b-29e973f97a0f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8947c30-7d7a-4fa1-a4d6-21bab03655a0', 'serial': 'e8947c30-7d7a-4fa1-a4d6-21bab03655a0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:15:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 10:15:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.compute.manager [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'vcpu_model' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:13 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:13 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:13 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 807403520 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be6604f-cc0d-4de0-958b-3ab46618f83b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:15:13 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4c8fa-2d5e-437d-b21c-a10af062b310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0] added
Aug 17 10:15:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ebc45a-3928-4fe1-a331-4335574c79e1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] No waiting events found dispatching network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:13 user nova-compute[73158]: WARNING nova.compute.manager [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received unexpected event network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 for instance with vm_state building and task_state spawning.
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-7da6cd0d-96c3-4bec-9f1f-ad7df980bd25 req-0d32f425-81d7-4dc7-93cf-a3bd48685848 service nova] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Received event network-vif-deleted-43982739-d0ed-4ec8-9576-31879af40e8a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.742s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7c8c8-75ee-43c3-b10e-abe003d83d2c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfivLalV {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfivLalV" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb3865-42ef-4774-ae5a-a4db1ba47a46]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfivLalV'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Deleted allocations for instance 4fe0d193-0f59-449a-89d1-e9445cad5038
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b526d5ff-8529-433d-8f4b-829ef3707883]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f0a5c-37bf-497f-a4d9-dd2195355a47]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:13 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-259da7cc-d107-427a-bb15-931d0926e01f tempest-VolumesAssistedSnapshotsTest-547804155 tempest-VolumesAssistedSnapshotsTest-547804155-project-member] Lock "4fe0d193-0f59-449a-89d1-e9445cad5038" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.999s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267313.6643999, d2cf001d-2354-463a-8683-e023222bfc9b => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] VM Resumed (Lifecycle Event)
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Instance spawned successfully.
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 959447040 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267313.664769, d2cf001d-2354-463a-8683-e023222bfc9b => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] VM Started (Lifecycle Event)
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:15:13 user nova-compute[73158]: INFO nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Took 9.12 seconds to spawn the instance on the hypervisor.
Aug 17 10:15:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:14 user nova-compute[73158]: INFO nova.compute.manager [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Took 10.07 seconds to build instance.
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d521580-d707-4b50-89fd-958dd044e04b tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "d2cf001d-2354-463a-8683-e023222bfc9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.218s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-d7670095-856a-4585-9e5d-e8382297198e req-9a8969a0-8b09-4c7a-b624-5ee6ee172544 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d7670095-856a-4585-9e5d-e8382297198e req-9a8969a0-8b09-4c7a-b624-5ee6ee172544 service nova] Acquiring lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d7670095-856a-4585-9e5d-e8382297198e req-9a8969a0-8b09-4c7a-b624-5ee6ee172544 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d7670095-856a-4585-9e5d-e8382297198e req-9a8969a0-8b09-4c7a-b624-5ee6ee172544 service nova] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-d7670095-856a-4585-9e5d-e8382297198e req-9a8969a0-8b09-4c7a-b624-5ee6ee172544 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] No waiting events found dispatching network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:14 user nova-compute[73158]: WARNING nova.compute.manager [req-d7670095-856a-4585-9e5d-e8382297198e req-9a8969a0-8b09-4c7a-b624-5ee6ee172544 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received unexpected event network-vif-plugged-401613bc-ae59-486b-9aa8-ef866b1dc8d7 for instance with vm_state active and task_state deleting.
Aug 17 10:15:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSoghsku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --login" returned: 0 in 1.094s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[783811e0-71c9-44d6-86c5-cbe04424dbd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]
Aug 17 10:15:14 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[749ebbbe-7b33-4e46-a85b-64f018d5e017]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc64146-b2c3-45c0-b1c5-750df36fc176]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:14 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.445s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] HCTL ('38', '-', '-', 0) found on session 14 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.050s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be5c2b-702c-412b-a199-8358483a02fd]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:15:14 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Took 1.59 seconds to deallocate network for instance.
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:15 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Deleted allocations for instance 6e23eb52-c52f-4ae4-912c-f7d517ba78a4
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-9894b51e-16bc-4bd1-bde0-4ee738de96e3 req-5212255c-3102-4b39-9e41-b0f7aaba5706 service nova] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Received event network-vif-deleted-401613bc-ae59-486b-9aa8-ef866b1dc8d7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-303b04e9-2652-4de7-aa50-698ef125a898 tempest-AttachSCSIVolumeTestJSON-1442195416 tempest-AttachSCSIVolumeTestJSON-1442195416-project-member] Lock "6e23eb52-c52f-4ae4-912c-f7d517ba78a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.678s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.509s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== connect_volume: return (2512ms) {'type': 'block', 'scsi_wwn': '23335326636636130', 'path': '/dev/sdg'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335326636636130', 'path': '/dev/sdg'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.224s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-469509928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1830998465',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp13s87YsSP5hXLXc3oT8gJDyNrfg0qxxuhSOTIUV/wq7nkQKQpqWZkXMVscmA9MWfKqzW6Zzzyd6dWMztqDvVyV/bCj1V6/KYCJfxNHY0Rts1QnrfR7feMD/5zrB3fOQ==',key_name='tempest-keypair-1685511148',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85c1113c081e46ada5ee3a9ca5004d15',ramdisk_id='',reservation_id='r-jbslfto5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1012743389',owner_user_name='tempest-ServerActionsV293TestJSON-1012743389-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d84e880a3e2f4707b3d58e353281fbd0',uuid=f877b207-950b-4c69-9e6b-29e973f97a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converting VIF {"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:15:15 user nova-compute[73158]:   <uuid>f877b207-950b-4c69-9e6b-29e973f97a0f</uuid>
Aug 17 10:15:15 user nova-compute[73158]:   <name>instance-00000009</name>
Aug 17 10:15:15 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:15:15 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:15:15 user nova-compute[73158]:   <metadata>
Aug 17 10:15:15 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:15:15 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:15:15 user nova-compute[73158]:       <nova:name>tempest-ServerActionsV293TestJSON-server-469509928</nova:name>
Aug 17 10:15:15 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:15:13</nova:creationTime>
Aug 17 10:15:15 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:15:15 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:15:15 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:15:15 user nova-compute[73158]:       <nova:owner>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:user uuid="d84e880a3e2f4707b3d58e353281fbd0">tempest-ServerActionsV293TestJSON-1012743389-project-member</nova:user>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:project uuid="85c1113c081e46ada5ee3a9ca5004d15">tempest-ServerActionsV293TestJSON-1012743389</nova:project>
Aug 17 10:15:15 user nova-compute[73158]:       </nova:owner>
Aug 17 10:15:15 user nova-compute[73158]:       <nova:ports>
Aug 17 10:15:15 user nova-compute[73158]:         <nova:port uuid="6f21dff0-22a2-431e-ab50-33b7956a0a5f">
Aug 17 10:15:15 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:15:15 user nova-compute[73158]:         </nova:port>
Aug 17 10:15:15 user nova-compute[73158]:       </nova:ports>
Aug 17 10:15:15 user nova-compute[73158]:     </nova:instance>
Aug 17 10:15:15 user nova-compute[73158]:   </metadata>
Aug 17 10:15:15 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:15:15 user nova-compute[73158]:     <system>
Aug 17 10:15:15 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:15:15 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:15:15 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:15:15 user nova-compute[73158]:       <entry name="serial">f877b207-950b-4c69-9e6b-29e973f97a0f</entry>
Aug 17 10:15:15 user nova-compute[73158]:       <entry name="uuid">f877b207-950b-4c69-9e6b-29e973f97a0f</entry>
Aug 17 10:15:15 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:15:15 user nova-compute[73158]:     </system>
Aug 17 10:15:15 user nova-compute[73158]:   </sysinfo>
Aug 17 10:15:15 user nova-compute[73158]:   <os>
Aug 17 10:15:15 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:15:15 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:15:15 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:15:15 user nova-compute[73158]:   </os>
Aug 17 10:15:15 user nova-compute[73158]:   <features>
Aug 17 10:15:15 user nova-compute[73158]:     <acpi/>
Aug 17 10:15:15 user nova-compute[73158]:     <apic/>
Aug 17 10:15:15 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:15:15 user nova-compute[73158]:   </features>
Aug 17 10:15:15 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:15:15 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:15:15 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:15:15 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:15:15 user nova-compute[73158]:   </clock>
Aug 17 10:15:15 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:15:15 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:15:15 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:15:15 user nova-compute[73158]:   </cpu>
Aug 17 10:15:15 user nova-compute[73158]:   <devices>
Aug 17 10:15:15 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:15:15 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:15:15 user nova-compute[73158]:       <source dev="/dev/sdg"/>
Aug 17 10:15:15 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:15:15 user nova-compute[73158]:       <serial>e8947c30-7d7a-4fa1-a4d6-21bab03655a0</serial>
Aug 17 10:15:15 user nova-compute[73158]:     </disk>
Aug 17 10:15:15 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:15:15 user nova-compute[73158]:       <mac address="fa:16:3e:06:22:49"/>
Aug 17 10:15:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:15 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:15:15 user nova-compute[73158]:       <target dev="tap6f21dff0-22"/>
Aug 17 10:15:15 user nova-compute[73158]:     </interface>
Aug 17 10:15:15 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:15:15 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f/console.log" append="off"/>
Aug 17 10:15:15 user nova-compute[73158]:     </serial>
Aug 17 10:15:15 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:15:15 user nova-compute[73158]:     <video>
Aug 17 10:15:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:15 user nova-compute[73158]:     </video>
Aug 17 10:15:15 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:15:15 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:15:15 user nova-compute[73158]:     </rng>
Aug 17 10:15:15 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:15:15 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:15:15 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:15:15 user nova-compute[73158]:     </memballoon>
Aug 17 10:15:15 user nova-compute[73158]:   </devices>
Aug 17 10:15:15 user nova-compute[73158]: </domain>
Aug 17 10:15:15 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-469509928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1830998465',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp13s87YsSP5hXLXc3oT8gJDyNrfg0qxxuhSOTIUV/wq7nkQKQpqWZkXMVscmA9MWfKqzW6Zzzyd6dWMztqDvVyV/bCj1V6/KYCJfxNHY0Rts1QnrfR7feMD/5zrB3fOQ==',key_name='tempest-keypair-1685511148',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85c1113c081e46ada5ee3a9ca5004d15',ramdisk_id='',reservation_id='r-jbslfto5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1012743389',owner_user_name='tempest-ServerActionsV293TestJSON-1012743389-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d84e880a3e2f4707b3d58e353281fbd0',uuid=f877b207-950b-4c69-9e6b-29e973f97a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converting VIF {"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470361b-5444-4d2f-8c16-f269fd9a456d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f21dff0-22, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f21dff0-22, col_values=(('external_ids', {'iface-id': '6f21dff0-22a2-431e-ab50-33b7956a0a5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:22:49', 'vm-uuid': 'f877b207-950b-4c69-9e6b-29e973f97a0f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:15 user nova-compute[73158]: INFO os_vif [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22')
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429a2e6-1878-453c-8890-147e89087839]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:15 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc426dad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84918872-62e3-4edf-a1e5-2cb1e891ef10]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] No VIF found with MAC fa:16:3e:06:22:49, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd92b3-09c2-4bc3-a83a-6bcfb9951c96]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38bfa1d-a7e5-4edd-8b7b-7c335e24449d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357fdfa-2a1d-41dd-81f6-bd2cbc9104c5]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51134d1a-b344-4712-883a-b0b5534ac2f0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92b4d9-ee90-4b09-a3e4-4c008a29e98e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260]
Aug 17 10:15:16 user nova-compute[73158]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:16 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b9f60-4262-4782-953d-7e644e03e5e3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] <== disconnect_volume: return (1633ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8775f432-db12-4e5f-b484-37a1922742a6', 'attached_at': '', 'detached_at': '', 'volume_id': '398770f6-e628-4598-a485-4306cd31199c', 'serial'} {{(pid=73158) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 10:15:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] swap_volume: removing Cinder connection for volume 6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 {{(pid=73158) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] swap_volume: Updating volume 6bd5c278-5ba7-4bbc-93e0-85c0a37a4ed3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "jnNchMvY", "auth_password": "inSvlpbzYVhD8y", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "398770f6-e628-4598-a485-4306cd31199c"}, "status": "reserved", "instance": "8775f432-db12-4e5f-b484-37a1922742a6", "attached_at": "", "detached_at": "", "volume_id": "398770f6-e628-4598-a485-4306cd31199c", "serial": "398770f6-e628-4598-a485-4306cd31199c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '398770f6-e628-4598-a485-4306cd31199c', 'no_device': None, 'attachment_id': 'dbe8a057-cff0-43ce-99ba-be086ed7284e'} {{(pid=73158) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-66c79d95-f4e5-4ed6-b895-5ff8b1a137e5 tempest-TestVolumeSwap-1371959436 tempest-TestVolumeSwap-1371959436-project-admin] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.931s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-f73c788a-8433-4368-8489-39ea3a5731c0 req-4c36d8f8-232a-467b-a3dc-3dc8b94c1f34 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f73c788a-8433-4368-8489-39ea3a5731c0 req-4c36d8f8-232a-467b-a3dc-3dc8b94c1f34 service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f73c788a-8433-4368-8489-39ea3a5731c0 req-4c36d8f8-232a-467b-a3dc-3dc8b94c1f34 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f73c788a-8433-4368-8489-39ea3a5731c0 req-4c36d8f8-232a-467b-a3dc-3dc8b94c1f34 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-f73c788a-8433-4368-8489-39ea3a5731c0 req-4c36d8f8-232a-467b-a3dc-3dc8b94c1f34 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:17 user nova-compute[73158]: WARNING nova.compute.manager [req-f73c788a-8433-4368-8489-39ea3a5731c0 req-4c36d8f8-232a-467b-a3dc-3dc8b94c1f34 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state active and task_state rebuild_spawning.
Aug 17 10:15:18 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:18 user nova-compute[73158]: INFO nova.compute.manager [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Detaching volume 398770f6-e628-4598-a485-4306cd31199c
Aug 17 10:15:18 user nova-compute[73158]: INFO nova.virt.block_device [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Attempting to driver detach volume 398770f6-e628-4598-a485-4306cd31199c from mountpoint /dev/vdb
Aug 17 10:15:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Attempting to detach device vdb from instance 8775f432-db12-4e5f-b484-37a1922742a6 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:15:18 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:15:18 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:15:18 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:15:18 user nova-compute[73158]:   <serial>398770f6-e628-4598-a485-4306cd31199c</serial>
Aug 17 10:15:18 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:15:18 user nova-compute[73158]: </disk>
Aug 17 10:15:18 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:15:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Successfully detached device vdb from instance 8775f432-db12-4e5f-b484-37a1922742a6 from the persistent domain config.
Aug 17 10:15:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8775f432-db12-4e5f-b484-37a1922742a6 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:15:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:15:18 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:15:18 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:15:18 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:15:18 user nova-compute[73158]:   <serial>398770f6-e628-4598-a485-4306cd31199c</serial>
Aug 17 10:15:18 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:15:18 user nova-compute[73158]: </disk>
Aug 17 10:15:18 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267319.3947632, 8775f432-db12-4e5f-b484-37a1922742a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:15:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Successfully detached device vdb from instance 8775f432-db12-4e5f-b484-37a1922742a6 from the live domain config.
Aug 17 10:15:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnNchMvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '398770f6-e628-4598-a485-4306cd31199c'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:19 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d91741d-78fd-4852-9ae3-5dade26e7853]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1641279d-aee7-438b-bc07-aa2f8737e47b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:19 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6e15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e8112-ce97-442d-a512-1b089884f77f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a35d2-c39e-48c7-8ff0-41512b028c67]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[98334273-aba3-4e76-8ffa-e14bb41219dd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97712f-3fdf-41ec-86c6-bd0486bda09e]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b75702-2940-4485-8ef3-99a92054a450]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceba302-12e7-44ec-a027-4889e617925e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260]
Aug 17 10:15:19 user nova-compute[73158]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398770f6-e628-4598-a485-4306cd31199c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e8246a-e02d-4964-8a81-f1b0e3900d7f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] <== disconnect_volume: return (448ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-437aa354-5d41-463d-afd3-d4e62af05134 req-11493e3f-944f-4c27-a3f7-0e4910a3d5f7 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-437aa354-5d41-463d-afd3-d4e62af05134 req-11493e3f-944f-4c27-a3f7-0e4910a3d5f7 service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-437aa354-5d41-463d-afd3-d4e62af05134 req-11493e3f-944f-4c27-a3f7-0e4910a3d5f7 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-437aa354-5d41-463d-afd3-d4e62af05134 req-11493e3f-944f-4c27-a3f7-0e4910a3d5f7 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-437aa354-5d41-463d-afd3-d4e62af05134 req-11493e3f-944f-4c27-a3f7-0e4910a3d5f7 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:20 user nova-compute[73158]: WARNING nova.compute.manager [req-437aa354-5d41-463d-afd3-d4e62af05134 req-11493e3f-944f-4c27-a3f7-0e4910a3d5f7 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state active and task_state rebuild_spawning.
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267320.5298645, f877b207-950b-4c69-9e6b-29e973f97a0f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:20 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] VM Resumed (Lifecycle Event)
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:15:20 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance spawned successfully.
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:20 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267320.5314927, f877b207-950b-4c69-9e6b-29e973f97a0f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:20 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] VM Started (Lifecycle Event)
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:15:20 user nova-compute[73158]: INFO nova.compute.claims [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Claim successful on node user
Aug 17 10:15:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:20 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 10:15:20 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lazy-loading 'flavor' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ee872042-14f0-48c9-97bf-30ee66ae9156 tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.443s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.785s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.542s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73158) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:15:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-be5f063d-568c-4f81-b408-aec7bd89e99b tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.127s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:15:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Creating image(s)
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.246s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating instance_info_cache with network_info: [{"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.policy [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6db6c1120b74ffbb1bf354c509d27ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44597afe7d404702983ba1555116e936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-c3b24204-badc-4d40-9b96-5a8b07a49250" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.272s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk 1073741824" returned: 0 in 0.087s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.248s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.281s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Cannot resize image /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:15:22 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'migration_context' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Ensure instance console log exists: /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Successfully created port: 7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Successfully updated port: 7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquired lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-changed-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Refreshing instance network info cache due to event network-changed-7be9163a-0c94-4891-8449-84d9a81abf29. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] Acquiring lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating instance_info_cache with network_info: [{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Releasing lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance network_info: |[{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] Acquired lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.neutron [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Refreshing network info cache for port 7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Start _get_guest_xml network_info=[{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:15:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1073118539',display_name='tempest-tempest.common.compute-instance-1073118539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1073118539',id=13,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG4LLkTmKho7/DQkyMNHGblsl70hzP8HYWZF20OVinvBCArgUJTLIzfiZocc2B8phKSY8gneCeCgsuHYXDlUAabL2CpzyN29TsJEHurUvK+CymBK24Ui19oF18ADrR4nw==',key_name='tempest-keypair-1229036182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-edr8e3uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_devices' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:15:24 user nova-compute[73158]:   <uuid>d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f</uuid>
Aug 17 10:15:24 user nova-compute[73158]:   <name>instance-0000000d</name>
Aug 17 10:15:24 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:15:24 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:15:24 user nova-compute[73158]:   <metadata>
Aug 17 10:15:24 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:15:24 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:15:24 user nova-compute[73158]:       <nova:name>tempest-tempest.common.compute-instance-1073118539</nova:name>
Aug 17 10:15:24 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:15:24</nova:creationTime>
Aug 17 10:15:24 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:15:24 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:15:24 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:15:24 user nova-compute[73158]:       <nova:owner>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:user uuid="a6db6c1120b74ffbb1bf354c509d27ec">tempest-ServerActionsTestOtherA-1163059526-project-member</nova:user>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:project uuid="44597afe7d404702983ba1555116e936">tempest-ServerActionsTestOtherA-1163059526</nova:project>
Aug 17 10:15:24 user nova-compute[73158]:       </nova:owner>
Aug 17 10:15:24 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:15:24 user nova-compute[73158]:       <nova:ports>
Aug 17 10:15:24 user nova-compute[73158]:         <nova:port uuid="7be9163a-0c94-4891-8449-84d9a81abf29">
Aug 17 10:15:24 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 10:15:24 user nova-compute[73158]:         </nova:port>
Aug 17 10:15:24 user nova-compute[73158]:       </nova:ports>
Aug 17 10:15:24 user nova-compute[73158]:     </nova:instance>
Aug 17 10:15:24 user nova-compute[73158]:   </metadata>
Aug 17 10:15:24 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:15:24 user nova-compute[73158]:     <system>
Aug 17 10:15:24 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:15:24 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:15:24 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:15:24 user nova-compute[73158]:       <entry name="serial">d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f</entry>
Aug 17 10:15:24 user nova-compute[73158]:       <entry name="uuid">d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f</entry>
Aug 17 10:15:24 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:15:24 user nova-compute[73158]:     </system>
Aug 17 10:15:24 user nova-compute[73158]:   </sysinfo>
Aug 17 10:15:24 user nova-compute[73158]:   <os>
Aug 17 10:15:24 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:15:24 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:15:24 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:15:24 user nova-compute[73158]:   </os>
Aug 17 10:15:24 user nova-compute[73158]:   <features>
Aug 17 10:15:24 user nova-compute[73158]:     <acpi/>
Aug 17 10:15:24 user nova-compute[73158]:     <apic/>
Aug 17 10:15:24 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:15:24 user nova-compute[73158]:   </features>
Aug 17 10:15:24 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:15:24 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:15:24 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:15:24 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:15:24 user nova-compute[73158]:   </clock>
Aug 17 10:15:24 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:15:24 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:15:24 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:15:24 user nova-compute[73158]:   </cpu>
Aug 17 10:15:24 user nova-compute[73158]:   <devices>
Aug 17 10:15:24 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:15:24 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:15:24 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk"/>
Aug 17 10:15:24 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:15:24 user nova-compute[73158]:     </disk>
Aug 17 10:15:24 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:15:24 user nova-compute[73158]:       <mac address="fa:16:3e:f5:c3:be"/>
Aug 17 10:15:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:24 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:15:24 user nova-compute[73158]:       <target dev="tap7be9163a-0c"/>
Aug 17 10:15:24 user nova-compute[73158]:     </interface>
Aug 17 10:15:24 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:15:24 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/console.log" append="off"/>
Aug 17 10:15:24 user nova-compute[73158]:     </serial>
Aug 17 10:15:24 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:15:24 user nova-compute[73158]:     <video>
Aug 17 10:15:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:24 user nova-compute[73158]:     </video>
Aug 17 10:15:24 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:15:24 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:15:24 user nova-compute[73158]:     </rng>
Aug 17 10:15:24 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:15:24 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:15:24 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:15:24 user nova-compute[73158]:     </memballoon>
Aug 17 10:15:24 user nova-compute[73158]:   </devices>
Aug 17 10:15:24 user nova-compute[73158]: </domain>
Aug 17 10:15:24 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1073118539',display_name='tempest-tempest.common.compute-instance-1073118539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1073118539',id=13,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG4LLkTmKho7/DQkyMNHGblsl70hzP8HYWZF20OVinvBCArgUJTLIzfiZocc2B8phKSY8gneCeCgsuHYXDlUAabL2CpzyN29TsJEHurUvK+CymBK24Ui19oF18ADrR4nw==',key_name='tempest-keypair-1229036182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-edr8e3uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG os_vif [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be9163a-0c, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7be9163a-0c, col_values=(('external_ids', {'iface-id': '7be9163a-0c94-4891-8449-84d9a81abf29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c3:be', 'vm-uuid': 'd6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:24 user nova-compute[73158]: INFO os_vif [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c')
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267309.9656808, 4fe0d193-0f59-449a-89d1-e9445cad5038 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:24 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] VM Stopped (Lifecycle Event)
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:15:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No VIF found with MAC fa:16:3e:f5:c3:be, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e4a8081a-28a1-41fc-aa7d-228c0295556c None None] [instance: 4fe0d193-0f59-449a-89d1-e9445cad5038] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updated VIF entry in instance network info cache for port 7be9163a-0c94-4891-8449-84d9a81abf29. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating instance_info_cache with network_info: [{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1056d142-8546-4b45-a80a-819569e8da80 req-ffc5f323-3b9d-4b75-b5ec-b20f786c9080 service nova] Releasing lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267329.351937, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] VM Resumed (Lifecycle Event)
Aug 17 10:15:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267312.8979933, 6e23eb52-c52f-4ae4-912c-f7d517ba78a4 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:29 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] VM Stopped (Lifecycle Event)
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-683b8904-3770-4324-83b0-94da17a312c8 req-7279107f-fdc8-4dd7-af23-bd81eeb84077 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-683b8904-3770-4324-83b0-94da17a312c8 req-7279107f-fdc8-4dd7-af23-bd81eeb84077 service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-683b8904-3770-4324-83b0-94da17a312c8 req-7279107f-fdc8-4dd7-af23-bd81eeb84077 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-683b8904-3770-4324-83b0-94da17a312c8 req-7279107f-fdc8-4dd7-af23-bd81eeb84077 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-683b8904-3770-4324-83b0-94da17a312c8 req-7279107f-fdc8-4dd7-af23-bd81eeb84077 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:29 user nova-compute[73158]: WARNING nova.compute.manager [req-683b8904-3770-4324-83b0-94da17a312c8 req-7279107f-fdc8-4dd7-af23-bd81eeb84077 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state building and task_state spawning.
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-313feeb7-6495-4c5d-8095-e81df721927a req-d5716542-c8b6-4d04-8245-5e32de719b07 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-313feeb7-6495-4c5d-8095-e81df721927a req-d5716542-c8b6-4d04-8245-5e32de719b07 service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-313feeb7-6495-4c5d-8095-e81df721927a req-d5716542-c8b6-4d04-8245-5e32de719b07 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-313feeb7-6495-4c5d-8095-e81df721927a req-d5716542-c8b6-4d04-8245-5e32de719b07 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-313feeb7-6495-4c5d-8095-e81df721927a req-d5716542-c8b6-4d04-8245-5e32de719b07 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:29 user nova-compute[73158]: WARNING nova.compute.manager [req-313feeb7-6495-4c5d-8095-e81df721927a req-d5716542-c8b6-4d04-8245-5e32de719b07 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state building and task_state spawning.
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1a52e3da-abbe-46b7-bbc1-eb852c1bbf5c None None] [instance: 6e23eb52-c52f-4ae4-912c-f7d517ba78a4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:29 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:29 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=24.667373657226562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance spawned successfully.
Aug 17 10:15:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267329.3531125, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] VM Started (Lifecycle Event)
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:15:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:30 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:15:30 user nova-compute[73158]: INFO nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Took 8.31 seconds to spawn the instance on the hypervisor.
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c3b24204-badc-4d40-9b96-5a8b07a49250 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8775f432-db12-4e5f-b484-37a1922742a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f877b207-950b-4c69-9e6b-29e973f97a0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 0a009128-dfff-4daf-b52c-28c6a06020ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2cf001d-2354-463a-8683-e023222bfc9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:15:30 user nova-compute[73158]: INFO nova.compute.manager [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Took 9.63 seconds to build instance.
Aug 17 10:15:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fa40683c-494e-4866-812b-96f6af397fbb tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.791s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:15:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.832s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-changed-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing instance network info cache due to event network-changed-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:15:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] Acquiring lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] Acquired lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:34 user nova-compute[73158]: DEBUG nova.network.neutron [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Refreshing network info cache for port bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:15:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:35 user nova-compute[73158]: DEBUG nova.network.neutron [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updated VIF entry in instance network info cache for port bf29118b-9fd8-4bf8-b932-e86dd5e1c43e. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:15:35 user nova-compute[73158]: DEBUG nova.network.neutron [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-118ae07a-1850-4091-9352-ddd28ae5a46f req-3cd409d5-c93c-4bde-82e6-2827e9068e5b service nova] Releasing lock "refresh_cache-0a009128-dfff-4daf-b52c-28c6a06020ea" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:37 user nova-compute[73158]: INFO nova.compute.manager [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Terminating instance
Aug 17 10:15:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb8d3375-fd26-450f-a5c2-163d4d759b10 req-9e3b5a05-776f-4103-a3f3-f2dc74a00639 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb8d3375-fd26-450f-a5c2-163d4d759b10 req-9e3b5a05-776f-4103-a3f3-f2dc74a00639 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb8d3375-fd26-450f-a5c2-163d4d759b10 req-9e3b5a05-776f-4103-a3f3-f2dc74a00639 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb8d3375-fd26-450f-a5c2-163d4d759b10 req-9e3b5a05-776f-4103-a3f3-f2dc74a00639 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb8d3375-fd26-450f-a5c2-163d4d759b10 req-9e3b5a05-776f-4103-a3f3-f2dc74a00639 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb8d3375-fd26-450f-a5c2-163d4d759b10 req-9e3b5a05-776f-4103-a3f3-f2dc74a00639 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-63aeaceb-e482-4b4e-a953-4e3d00b49927 req-61ef2225-0965-4288-b7df-5f45990c3905 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-63aeaceb-e482-4b4e-a953-4e3d00b49927 req-61ef2225-0965-4288-b7df-5f45990c3905 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-63aeaceb-e482-4b4e-a953-4e3d00b49927 req-61ef2225-0965-4288-b7df-5f45990c3905 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-63aeaceb-e482-4b4e-a953-4e3d00b49927 req-61ef2225-0965-4288-b7df-5f45990c3905 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-63aeaceb-e482-4b4e-a953-4e3d00b49927 req-61ef2225-0965-4288-b7df-5f45990c3905 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-63aeaceb-e482-4b4e-a953-4e3d00b49927 req-61ef2225-0965-4288-b7df-5f45990c3905 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Instance destroyed successfully.
Aug 17 10:15:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lazy-loading 'resources' on Instance uuid 0a009128-dfff-4daf-b52c-28c6a06020ea {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf29118b-9f, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:75:95,bridge_name='br-int',has_traffic_filtering=True,id=bf29118b-9fd8-4bf8-b932-e86dd5e1c43e,network=Network(937a28e1-1747-4a9c-9c5d-ebf9120e6009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29118b-9f')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf53e3226-bc, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1f:89,bridge_name='br-int',has_traffic_filtering=True,id=f53e3226-bc3d-4098-a408-c6e3f2b9863f,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf53e3226-bc')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93ab344-3d, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:85,bridge_name='br-int',has_traffic_filtering=True,id=f93ab344-3dd8-4042-a095-240db4de39ca,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf93ab344-3d')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "address": "fa:16:3e:0c:02:9c", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb341c9f6-3d", "ovs_interfaceid": "b341c9f6-3dc9-4097-a98e-55f60f09de5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb341c9f6-3d, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:02:9c,bridge_name='br-int',has_traffic_filtering=True,id=b341c9f6-3dc9-4097-a98e-55f60f09de5e,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb341c9f6-3d')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31092420-87, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:62:79,bridge_name='br-int',has_traffic_filtering=True,id=31092420-8772-42ab-a035-b1d08f9e5ee5,network=Network(60d5b565-2a66-4c9a-ab7e-82b5fe719ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31092420-87')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36768574-c0, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:3c,bridge_name='br-int',has_traffic_filtering=True,id=36768574-c029-4535-b556-3f4e873766c4,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36768574-c0')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-414769228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-414769228',id=10,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWO85KLHZqpGsTSlrqt2u1zChXBT5HShl6FiRxBNkZ1dQS9m5Uwsk2tVckieClXl+f+dIZ2Sc6aY69n3fkisThIDASEezeCaDNGhZSctwpCgC6wm53sDYKmubadWg8kQ==',key_name='tempest-keypair-570929396',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3fedff7020141198e351516a0242942',ramdisk_id='',reservation_id='r-qkcvk27b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1220221276',owner_user_name='tempest-TaggedBootDevicesTest-1220221276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbbcb454697e46898d182e727c4d5f55',uuid=0a009128-dfff-4daf-b52c-28c6a06020ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converting VIF {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde7017b5-e1, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:40 user nova-compute[73158]: INFO os_vif [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:40:40,bridge_name='br-int',has_traffic_filtering=True,id=de7017b5-e1a6-4af6-a409-04e6444085b2,network=Network(f319a713-3973-4b0b-a6a8-c3c1a9ec7209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde7017b5-e1')
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbkVHPXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be88a81-4f4c-4d87-9f3d-425d9e746626]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[682fc447-e2e6-4aa8-8d09-e99a8b7849fd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3c154550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e6f3ee-6a12-4cfe-97a5-4c811db736ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[de907250-047c-4f83-96f9-499c8a206311]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f296486e-afad-4ddf-8b6d-93a480bd5664]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: WARNING nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e for instance with vm_state active and task_state deleting.
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: WARNING nova.compute.manager [req-12dc0105-db28-4ff6-8748-8720c4a2b275 req-840b14af-0703-4338-8db0-03da547d1d4b service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-b341c9f6-3dc9-4097-a98e-55f60f09de5e for instance with vm_state active and task_state deleting.
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e458761-8802-4bd3-ad8f-596ad96ef282]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0255bb-d06c-4b6f-9d22-e70df9558833]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd096b12-c881-47a1-96b6-5e9171bedd2b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260]
Aug 17 10:15:40 user nova-compute[73158]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa98d820-5ff7-4dbf-aca7-8fbdb522e375 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b53ea0-ec47-4902-af9b-b58e824a1f8d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== disconnect_volume: return (360ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSMhQNsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad4aa6-189d-4de0-9c78-3712cd9e3fbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f7297-88d9-4761-9809-86a408fe6112]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f (non-flash)
Aug 17 10:15:40 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c47c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f'): ({'sdd'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Removing single pathed devices sdd {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d5f96-4efd-42b5-8a9c-b10f906a2263]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a966a-718b-40fc-931c-a42735fbebe7]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Flushing IO for device /dev/sdd {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6196d8c3-fe0b-49d3-a5d1-2d18ff80bf44]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: WARNING nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-f53e3226-bc3d-4098-a408-c6e3f2b9863f for instance with vm_state active and task_state deleting.
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-f93ab344-3dd8-4042-a095-240db4de39ca for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: WARNING nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-f93ab344-3dd8-4042-a095-240db4de39ca for instance with vm_state active and task_state deleting.
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-73bd00df-fa3f-4ad0-8f80-2b4c24aaa7a3 req-68adbef0-293e-4d77-8be6-a07d2d73c33d service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-31092420-8772-42ab-a035-b1d08f9e5ee5 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3feca4-7215-4905-9272-b98f0d3fad23]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[06540e61-5854-460a-b707-9acaafaa9dce]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d0f4c-ec45-4f41-a6db-d2e171429748]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260]
Aug 17 10:15:41 user nova-compute[73158]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e668b874-b981-46b8-867f-817aa3374b6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c73f6-db44-47d9-a5b0-b25b2835b314]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== disconnect_volume: return (373ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJwoiZRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:15:41 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca77df-9e17-4fc2-8753-eab523f8394f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a074b8-9a74-4ed7-9ae5-4111082f65c2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:41 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:15:41 user nova-compute[73158]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 (non-flash)
Aug 17 10:15:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c146a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83'): ({'sde'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Removing single pathed devices sde {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[811fc318-eb38-4e17-af0c-d39cdee9f038]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb15c1e-71ac-4cd0-be69-c1c22a6537ab]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Flushing IO for device /dev/sde {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[385541ff-2243-4612-a240-7b240d47b687]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2166330-0608-4588-9821-55d2cfa37273]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[676418ba-5b9c-4413-a5fe-1947c50fdbc7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d798c48-c7f6-4665-b304-e52e8cd51ca6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260]
Aug 17 10:15:41 user nova-compute[73158]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83, portal: 172.16.0.220,3260] successful.
Aug 17 10:15:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b9895c-8274-4bbd-a2b4-4a01e951de83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b952276b-7c10-4e7f-90db-5ddb2c280e47]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] <== disconnect_volume: return (316ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:15:41 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Deleting instance files /opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea_del
Aug 17 10:15:41 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Deletion of /opt/stack/data/nova/instances/0a009128-dfff-4daf-b52c-28c6a06020ea_del complete
Aug 17 10:15:41 user nova-compute[73158]: INFO nova.compute.manager [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Took 3.97 seconds to destroy the instance on the hypervisor.
Aug 17 10:15:41 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:15:41 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:42 user nova-compute[73158]: WARNING nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-31092420-8772-42ab-a035-b1d08f9e5ee5 for instance with vm_state active and task_state deleting.
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-36768574-c029-4535-b556-3f4e873766c4 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:42 user nova-compute[73158]: WARNING nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-36768574-c029-4535-b556-3f4e873766c4 for instance with vm_state active and task_state deleting.
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-unplugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-unplugged-de7017b5-e1a6-4af6-a409-04e6444085b2 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Acquiring lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] No waiting events found dispatching network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:42 user nova-compute[73158]: WARNING nova.compute.manager [req-c03e4b6d-3cca-4cd9-955d-5c38c42c2a41 req-3e499eef-2d06-4cdf-9338-42df927b47e2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received unexpected event network-vif-plugged-de7017b5-e1a6-4af6-a409-04e6444085b2 for instance with vm_state active and task_state deleting.
Aug 17 10:15:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-43b45269-65af-4ab5-8915-f04c5d217654 req-41d8a1d1-c261-4958-9862-91ef3e50ca73 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-deleted-b341c9f6-3dc9-4097-a98e-55f60f09de5e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:45 user nova-compute[73158]: INFO nova.compute.manager [req-43b45269-65af-4ab5-8915-f04c5d217654 req-41d8a1d1-c261-4958-9862-91ef3e50ca73 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Neutron deleted interface b341c9f6-3dc9-4097-a98e-55f60f09de5e; detaching it from the instance and deleting it from the info cache
Aug 17 10:15:45 user nova-compute[73158]: DEBUG nova.network.neutron [req-43b45269-65af-4ab5-8915-f04c5d217654 req-41d8a1d1-c261-4958-9862-91ef3e50ca73 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36768574-c029-4535-b556-3f4e873766c4", "address": "fa:16:3e:45:10:3c", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36768574-c0", "ovs_interfaceid": "36768574-c029-4535-b556-3f4e873766c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-43b45269-65af-4ab5-8915-f04c5d217654 req-41d8a1d1-c261-4958-9862-91ef3e50ca73 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Detach interface failed, port_id=b341c9f6-3dc9-4097-a98e-55f60f09de5e, reason: Instance 0a009128-dfff-4daf-b52c-28c6a06020ea could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:15:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7c3af3d-5537-4e24-bbc7-8d0196af0c17 req-50cbe853-bc7b-4d61-85e7-06eee7a7b33a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-deleted-36768574-c029-4535-b556-3f4e873766c4 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:47 user nova-compute[73158]: INFO nova.compute.manager [req-f7c3af3d-5537-4e24-bbc7-8d0196af0c17 req-50cbe853-bc7b-4d61-85e7-06eee7a7b33a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Neutron deleted interface 36768574-c029-4535-b556-3f4e873766c4; detaching it from the instance and deleting it from the info cache
Aug 17 10:15:47 user nova-compute[73158]: DEBUG nova.network.neutron [req-f7c3af3d-5537-4e24-bbc7-8d0196af0c17 req-50cbe853-bc7b-4d61-85e7-06eee7a7b33a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [{"id": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "address": "fa:16:3e:fe:75:95", "network": {"id": "937a28e1-1747-4a9c-9c5d-ebf9120e6009", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-536775822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29118b-9f", "ovs_interfaceid": "bf29118b-9fd8-4bf8-b932-e86dd5e1c43e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "address": "fa:16:3e:ff:1f:89", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53e3226-bc", "ovs_interfaceid": "f53e3226-bc3d-4098-a408-c6e3f2b9863f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f93ab344-3dd8-4042-a095-240db4de39ca", "address": "fa:16:3e:6d:40:85", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93ab344-3d", "ovs_interfaceid": "f93ab344-3dd8-4042-a095-240db4de39ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31092420-8772-42ab-a035-b1d08f9e5ee5", "address": "fa:16:3e:64:62:79", "network": {"id": "60d5b565-2a66-4c9a-ab7e-82b5fe719ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-849415171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31092420-87", "ovs_interfaceid": "31092420-8772-42ab-a035-b1d08f9e5ee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de7017b5-e1a6-4af6-a409-04e6444085b2", "address": "fa:16:3e:ce:40:40", "network": {"id": "f319a713-3973-4b0b-a6a8-c3c1a9ec7209", "bridge": "br-int", "label": "tempest-device-tagging-net2-712661723", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3fedff7020141198e351516a0242942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde7017b5-e1", "ovs_interfaceid": "de7017b5-e1a6-4af6-a409-04e6444085b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7c3af3d-5537-4e24-bbc7-8d0196af0c17 req-50cbe853-bc7b-4d61-85e7-06eee7a7b33a service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Detach interface failed, port_id=36768574-c029-4535-b556-3f4e873766c4, reason: Instance 0a009128-dfff-4daf-b52c-28c6a06020ea could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:15:48 user nova-compute[73158]: INFO nova.compute.claims [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Claim successful on node user
Aug 17 10:15:48 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:15:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:15:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Creating image(s)
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "/opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "/opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.208s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.policy [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e43e55ab6d054c4f9c33c59d35b6c9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbc5c66f0234a1d90ac3b6c97ebf690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:49 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Took 8.06 seconds to deallocate network for instance.
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.224s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk 1073741824" returned: 0 in 0.050s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e90e6c7-d571-4635-89d2-3f47cd6e26bc req-eaeb6c9c-c8cc-4fc7-b6d9-8923285ed1f2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-deleted-bf29118b-9fd8-4bf8-b932-e86dd5e1c43e {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e90e6c7-d571-4635-89d2-3f47cd6e26bc req-eaeb6c9c-c8cc-4fc7-b6d9-8923285ed1f2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-deleted-de7017b5-e1a6-4af6-a409-04e6444085b2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e90e6c7-d571-4635-89d2-3f47cd6e26bc req-eaeb6c9c-c8cc-4fc7-b6d9-8923285ed1f2 service nova] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Received event network-vif-deleted-31092420-8772-42ab-a035-b1d08f9e5ee5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:15:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Cannot resize image /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lazy-loading 'migration_context' on Instance uuid 6dbbeeed-8744-484d-bc7e-561a28305ec4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Ensure instance console log exists: /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Successfully created port: f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Successfully updated port: f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "refresh_cache-6dbbeeed-8744-484d-bc7e-561a28305ec4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquired lock "refresh_cache-6dbbeeed-8744-484d-bc7e-561a28305ec4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Updating instance_info_cache with network_info: [{"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Releasing lock "refresh_cache-6dbbeeed-8744-484d-bc7e-561a28305ec4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Instance network_info: |[{"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Start _get_guest_xml network_info=[{"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:15:51 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:51 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1747408933',display_name='tempest-VolumesNegativeTest-instance-1747408933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1747408933',id=14,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fbc5c66f0234a1d90ac3b6c97ebf690',ramdisk_id='',reservation_id='r-rjuob1hv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-160242110',owner_user_name='tempest-VolumesNegativeTest-160242110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:49Z,user_data=None,user_id='e43e55ab6d054c4f9c33c59d35b6c9b2',uuid=6dbbeeed-8744-484d-bc7e-561a28305ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Converting VIF {"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dbbeeed-8744-484d-bc7e-561a28305ec4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:15:51 user nova-compute[73158]:   <uuid>6dbbeeed-8744-484d-bc7e-561a28305ec4</uuid>
Aug 17 10:15:51 user nova-compute[73158]:   <name>instance-0000000e</name>
Aug 17 10:15:51 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:15:51 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:15:51 user nova-compute[73158]:   <metadata>
Aug 17 10:15:51 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:15:51 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:15:51 user nova-compute[73158]:       <nova:name>tempest-VolumesNegativeTest-instance-1747408933</nova:name>
Aug 17 10:15:51 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:15:51</nova:creationTime>
Aug 17 10:15:51 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:15:51 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:15:51 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:15:51 user nova-compute[73158]:       <nova:owner>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:user uuid="e43e55ab6d054c4f9c33c59d35b6c9b2">tempest-VolumesNegativeTest-160242110-project-member</nova:user>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:project uuid="2fbc5c66f0234a1d90ac3b6c97ebf690">tempest-VolumesNegativeTest-160242110</nova:project>
Aug 17 10:15:51 user nova-compute[73158]:       </nova:owner>
Aug 17 10:15:51 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:15:51 user nova-compute[73158]:       <nova:ports>
Aug 17 10:15:51 user nova-compute[73158]:         <nova:port uuid="f78f009c-a362-470b-9133-2afe9ff8a6f9">
Aug 17 10:15:51 user nova-compute[73158]:           <nova:ip type="fixed" address="192.168.233.218" ipVersion="4"/>
Aug 17 10:15:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:15:51 user nova-compute[73158]:       </nova:ports>
Aug 17 10:15:51 user nova-compute[73158]:     </nova:instance>
Aug 17 10:15:51 user nova-compute[73158]:   </metadata>
Aug 17 10:15:51 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:15:51 user nova-compute[73158]:     <system>
Aug 17 10:15:51 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:15:51 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:15:51 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:15:51 user nova-compute[73158]:       <entry name="serial">6dbbeeed-8744-484d-bc7e-561a28305ec4</entry>
Aug 17 10:15:51 user nova-compute[73158]:       <entry name="uuid">6dbbeeed-8744-484d-bc7e-561a28305ec4</entry>
Aug 17 10:15:51 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:15:51 user nova-compute[73158]:     </system>
Aug 17 10:15:51 user nova-compute[73158]:   </sysinfo>
Aug 17 10:15:51 user nova-compute[73158]:   <os>
Aug 17 10:15:51 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:15:51 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:15:51 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:15:51 user nova-compute[73158]:   </os>
Aug 17 10:15:51 user nova-compute[73158]:   <features>
Aug 17 10:15:51 user nova-compute[73158]:     <acpi/>
Aug 17 10:15:51 user nova-compute[73158]:     <apic/>
Aug 17 10:15:51 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:15:51 user nova-compute[73158]:   </features>
Aug 17 10:15:51 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:15:51 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:15:51 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:15:51 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:15:51 user nova-compute[73158]:   </clock>
Aug 17 10:15:51 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:15:51 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:15:51 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:15:51 user nova-compute[73158]:   </cpu>
Aug 17 10:15:51 user nova-compute[73158]:   <devices>
Aug 17 10:15:51 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:15:51 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:15:51 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk"/>
Aug 17 10:15:51 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:15:51 user nova-compute[73158]:     </disk>
Aug 17 10:15:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:15:51 user nova-compute[73158]:       <mac address="fa:16:3e:83:a5:ba"/>
Aug 17 10:15:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:15:51 user nova-compute[73158]:       <target dev="tapf78f009c-a3"/>
Aug 17 10:15:51 user nova-compute[73158]:     </interface>
Aug 17 10:15:51 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:15:51 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/console.log" append="off"/>
Aug 17 10:15:51 user nova-compute[73158]:     </serial>
Aug 17 10:15:51 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:15:51 user nova-compute[73158]:     <video>
Aug 17 10:15:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:51 user nova-compute[73158]:     </video>
Aug 17 10:15:51 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:15:51 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:15:51 user nova-compute[73158]:     </rng>
Aug 17 10:15:51 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:15:51 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:15:51 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:15:51 user nova-compute[73158]:     </memballoon>
Aug 17 10:15:51 user nova-compute[73158]:   </devices>
Aug 17 10:15:51 user nova-compute[73158]: </domain>
Aug 17 10:15:51 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1747408933',display_name='tempest-VolumesNegativeTest-instance-1747408933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1747408933',id=14,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fbc5c66f0234a1d90ac3b6c97ebf690',ramdisk_id='',reservation_id='r-rjuob1hv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-160242110',owner_user_name='tempest-VolumesNegativeTest-160242110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:49Z,user_data=None,user_id='e43e55ab6d054c4f9c33c59d35b6c9b2',uuid=6dbbeeed-8744-484d-bc7e-561a28305ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Converting VIF {"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG os_vif [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf78f009c-a3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf78f009c-a3, col_values=(('external_ids', {'iface-id': 'f78f009c-a362-470b-9133-2afe9ff8a6f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:a5:ba', 'vm-uuid': '6dbbeeed-8744-484d-bc7e-561a28305ec4'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-changed-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Refreshing instance network info cache due to event network-changed-f78f009c-a362-470b-9133-2afe9ff8a6f9. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] Acquiring lock "refresh_cache-6dbbeeed-8744-484d-bc7e-561a28305ec4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] Acquired lock "refresh_cache-6dbbeeed-8744-484d-bc7e-561a28305ec4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.network.neutron [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Refreshing network info cache for port f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:51 user nova-compute[73158]: INFO os_vif [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3')
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:15:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] No VIF found with MAC fa:16:3e:83:a5:ba, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:15:52 user nova-compute[73158]: INFO nova.compute.manager [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Took 2.48 seconds to detach 3 volumes for instance.
Aug 17 10:15:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG nova.network.neutron [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Updated VIF entry in instance network info cache for port f78f009c-a362-470b-9133-2afe9ff8a6f9. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG nova.network.neutron [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Updating instance_info_cache with network_info: [{"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daac4122-e7e5-44f9-92b3-00cf2da24636 req-edd26911-6a71-4605-8d0f-7561a157c7b5 service nova] Releasing lock "refresh_cache-6dbbeeed-8744-484d-bc7e-561a28305ec4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:52 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Deleted allocations for instance 0a009128-dfff-4daf-b52c-28c6a06020ea
Aug 17 10:15:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e902c803-bb0b-4654-bb09-6a8a8cfa5b34 tempest-TaggedBootDevicesTest-1220221276 tempest-TaggedBootDevicesTest-1220221276-project-member] Lock "0a009128-dfff-4daf-b52c-28c6a06020ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.109s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-1a50e0b5-fc21-485d-9524-885235d903ea req-bcb10b36-304d-4933-9585-6e9ebf67b2b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a50e0b5-fc21-485d-9524-885235d903ea req-bcb10b36-304d-4933-9585-6e9ebf67b2b5 service nova] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a50e0b5-fc21-485d-9524-885235d903ea req-bcb10b36-304d-4933-9585-6e9ebf67b2b5 service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a50e0b5-fc21-485d-9524-885235d903ea req-bcb10b36-304d-4933-9585-6e9ebf67b2b5 service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-1a50e0b5-fc21-485d-9524-885235d903ea req-bcb10b36-304d-4933-9585-6e9ebf67b2b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] No waiting events found dispatching network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:53 user nova-compute[73158]: WARNING nova.compute.manager [req-1a50e0b5-fc21-485d-9524-885235d903ea req-bcb10b36-304d-4933-9585-6e9ebf67b2b5 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received unexpected event network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 for instance with vm_state building and task_state spawning.
Aug 17 10:15:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "055c448d-c4b7-4852-b331-fab5b760f925" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:15:54 user nova-compute[73158]: INFO nova.compute.claims [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Claim successful on node user
Aug 17 10:15:54 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267339.92336, 0a009128-dfff-4daf-b52c-28c6a06020ea => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:54 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] VM Stopped (Lifecycle Event)
Aug 17 10:15:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-6f25ea96-bb66-4f62-9346-6850fab49e6d None None] [instance: 0a009128-dfff-4daf-b52c-28c6a06020ea] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:15:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.policy [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbecf64518ba437895e7816c5ad54b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07223795d5094ee1b75158a794497264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:15:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Creating image(s)
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "/opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "/opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "/opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-46ddf1a3-ae39-43e8-af47-c4faabc8b7a0 req-510e52c4-37a9-431a-ac58-dc8c8886175e service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-46ddf1a3-ae39-43e8-af47-c4faabc8b7a0 req-510e52c4-37a9-431a-ac58-dc8c8886175e service nova] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-46ddf1a3-ae39-43e8-af47-c4faabc8b7a0 req-510e52c4-37a9-431a-ac58-dc8c8886175e service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-46ddf1a3-ae39-43e8-af47-c4faabc8b7a0 req-510e52c4-37a9-431a-ac58-dc8c8886175e service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-46ddf1a3-ae39-43e8-af47-c4faabc8b7a0 req-510e52c4-37a9-431a-ac58-dc8c8886175e service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] No waiting events found dispatching network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:55 user nova-compute[73158]: WARNING nova.compute.manager [req-46ddf1a3-ae39-43e8-af47-c4faabc8b7a0 req-510e52c4-37a9-431a-ac58-dc8c8886175e service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received unexpected event network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 for instance with vm_state building and task_state spawning.
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.211s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267356.0880196, 6dbbeeed-8744-484d-bc7e-561a28305ec4 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] VM Resumed (Lifecycle Event)
Aug 17 10:15:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk 1073741824" returned: 0 in 0.072s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Successfully created port: e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Instance spawned successfully.
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267356.0898466, 6dbbeeed-8744-484d-bc7e-561a28305ec4 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] VM Started (Lifecycle Event)
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Took 7.18 seconds to spawn the instance on the hypervisor.
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:15:56 user nova-compute[73158]: INFO nova.compute.manager [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Took 8.04 seconds to build instance.
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cf27ee0-b22a-4541-98c4-429d34eb667f tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.145s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Cannot resize image /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lazy-loading 'migration_context' on Instance uuid 055c448d-c4b7-4852-b331-fab5b760f925 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Ensure instance console log exists: /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Successfully updated port: e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "refresh_cache-055c448d-c4b7-4852-b331-fab5b760f925" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquired lock "refresh_cache-055c448d-c4b7-4852-b331-fab5b760f925" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-changed-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Refreshing instance network info cache due to event network-changed-e776cd07-1380-4b9c-8606-18f24aeaa59d. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] Acquiring lock "refresh_cache-055c448d-c4b7-4852-b331-fab5b760f925" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Updating instance_info_cache with network_info: [{"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Releasing lock "refresh_cache-055c448d-c4b7-4852-b331-fab5b760f925" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Instance network_info: |[{"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] Acquired lock "refresh_cache-055c448d-c4b7-4852-b331-fab5b760f925" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.neutron [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Refreshing network info cache for port e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Start _get_guest_xml network_info=[{"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:15:57 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:57 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-248707735',display_name='tempest-VolumesActionsTest-instance-248707735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-248707735',id=15,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07223795d5094ee1b75158a794497264',ramdisk_id='',reservation_id='r-bvb2jvo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1130727858',owner_user_name='tempest-VolumesActionsTest-1130727858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:56Z,user_data=None,user_id='cbecf64518ba437895e7816c5ad54b9d',uuid=055c448d-c4b7-4852-b331-fab5b760f925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converting VIF {"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lazy-loading 'pci_devices' on Instance uuid 055c448d-c4b7-4852-b331-fab5b760f925 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:15:57 user nova-compute[73158]:   <uuid>055c448d-c4b7-4852-b331-fab5b760f925</uuid>
Aug 17 10:15:57 user nova-compute[73158]:   <name>instance-0000000f</name>
Aug 17 10:15:57 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:15:57 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:15:57 user nova-compute[73158]:   <metadata>
Aug 17 10:15:57 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:15:57 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:15:57 user nova-compute[73158]:       <nova:name>tempest-VolumesActionsTest-instance-248707735</nova:name>
Aug 17 10:15:57 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:15:57</nova:creationTime>
Aug 17 10:15:57 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:15:57 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:15:57 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:15:57 user nova-compute[73158]:       <nova:owner>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:user uuid="cbecf64518ba437895e7816c5ad54b9d">tempest-VolumesActionsTest-1130727858-project-member</nova:user>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:project uuid="07223795d5094ee1b75158a794497264">tempest-VolumesActionsTest-1130727858</nova:project>
Aug 17 10:15:57 user nova-compute[73158]:       </nova:owner>
Aug 17 10:15:57 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:15:57 user nova-compute[73158]:       <nova:ports>
Aug 17 10:15:57 user nova-compute[73158]:         <nova:port uuid="e776cd07-1380-4b9c-8606-18f24aeaa59d">
Aug 17 10:15:57 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 10:15:57 user nova-compute[73158]:         </nova:port>
Aug 17 10:15:57 user nova-compute[73158]:       </nova:ports>
Aug 17 10:15:57 user nova-compute[73158]:     </nova:instance>
Aug 17 10:15:57 user nova-compute[73158]:   </metadata>
Aug 17 10:15:57 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:15:57 user nova-compute[73158]:     <system>
Aug 17 10:15:57 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:15:57 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:15:57 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:15:57 user nova-compute[73158]:       <entry name="serial">055c448d-c4b7-4852-b331-fab5b760f925</entry>
Aug 17 10:15:57 user nova-compute[73158]:       <entry name="uuid">055c448d-c4b7-4852-b331-fab5b760f925</entry>
Aug 17 10:15:57 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:15:57 user nova-compute[73158]:     </system>
Aug 17 10:15:57 user nova-compute[73158]:   </sysinfo>
Aug 17 10:15:57 user nova-compute[73158]:   <os>
Aug 17 10:15:57 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:15:57 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:15:57 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:15:57 user nova-compute[73158]:   </os>
Aug 17 10:15:57 user nova-compute[73158]:   <features>
Aug 17 10:15:57 user nova-compute[73158]:     <acpi/>
Aug 17 10:15:57 user nova-compute[73158]:     <apic/>
Aug 17 10:15:57 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:15:57 user nova-compute[73158]:   </features>
Aug 17 10:15:57 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:15:57 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:15:57 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:15:57 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:15:57 user nova-compute[73158]:   </clock>
Aug 17 10:15:57 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:15:57 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:15:57 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:15:57 user nova-compute[73158]:   </cpu>
Aug 17 10:15:57 user nova-compute[73158]:   <devices>
Aug 17 10:15:57 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:15:57 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:15:57 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk"/>
Aug 17 10:15:57 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:15:57 user nova-compute[73158]:     </disk>
Aug 17 10:15:57 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:15:57 user nova-compute[73158]:       <mac address="fa:16:3e:2d:07:4b"/>
Aug 17 10:15:57 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:57 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:15:57 user nova-compute[73158]:       <target dev="tape776cd07-13"/>
Aug 17 10:15:57 user nova-compute[73158]:     </interface>
Aug 17 10:15:57 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:15:57 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/console.log" append="off"/>
Aug 17 10:15:57 user nova-compute[73158]:     </serial>
Aug 17 10:15:57 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:15:57 user nova-compute[73158]:     <video>
Aug 17 10:15:57 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:15:57 user nova-compute[73158]:     </video>
Aug 17 10:15:57 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:15:57 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:15:57 user nova-compute[73158]:     </rng>
Aug 17 10:15:57 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:15:57 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:15:57 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:15:57 user nova-compute[73158]:     </memballoon>
Aug 17 10:15:57 user nova-compute[73158]:   </devices>
Aug 17 10:15:57 user nova-compute[73158]: </domain>
Aug 17 10:15:57 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-248707735',display_name='tempest-VolumesActionsTest-instance-248707735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-248707735',id=15,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07223795d5094ee1b75158a794497264',ramdisk_id='',reservation_id='r-bvb2jvo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1130727858',owner_user_name='tempest-VolumesActionsTest-1130727858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:15:56Z,user_data=None,user_id='cbecf64518ba437895e7816c5ad54b9d',uuid=055c448d-c4b7-4852-b331-fab5b760f925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converting VIF {"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG os_vif [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape776cd07-13, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape776cd07-13, col_values=(('external_ids', {'iface-id': 'e776cd07-1380-4b9c-8606-18f24aeaa59d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:07:4b', 'vm-uuid': '055c448d-c4b7-4852-b331-fab5b760f925'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:57 user nova-compute[73158]: INFO os_vif [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13')
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:15:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] No VIF found with MAC fa:16:3e:2d:07:4b, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:15:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Updated VIF entry in instance network info cache for port e776cd07-1380-4b9c-8606-18f24aeaa59d. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:15:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Updating instance_info_cache with network_info: [{"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:15:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3b4f265d-d9a8-4f2b-82a5-43a41cbef1e3 req-eee23918-fc35-42d1-9c39-6d5c189252a2 service nova] Releasing lock "refresh_cache-055c448d-c4b7-4852-b331-fab5b760f925" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-4b181a87-fc6f-4ff8-92f0-f0638c8fc98e req-7fd190ee-1230-420e-a6de-54d8626d7520 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4b181a87-fc6f-4ff8-92f0-f0638c8fc98e req-7fd190ee-1230-420e-a6de-54d8626d7520 service nova] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4b181a87-fc6f-4ff8-92f0-f0638c8fc98e req-7fd190ee-1230-420e-a6de-54d8626d7520 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4b181a87-fc6f-4ff8-92f0-f0638c8fc98e req-7fd190ee-1230-420e-a6de-54d8626d7520 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:15:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-4b181a87-fc6f-4ff8-92f0-f0638c8fc98e req-7fd190ee-1230-420e-a6de-54d8626d7520 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] No waiting events found dispatching network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:15:59 user nova-compute[73158]: WARNING nova.compute.manager [req-4b181a87-fc6f-4ff8-92f0-f0638c8fc98e req-7fd190ee-1230-420e-a6de-54d8626d7520 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received unexpected event network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d for instance with vm_state building and task_state spawning.
Aug 17 10:16:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-48cee8f5-eb4c-40bf-9d9c-a356aaf3959d req-268a57dd-bc02-4b8b-bfbf-94cd93f6ef49 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-48cee8f5-eb4c-40bf-9d9c-a356aaf3959d req-268a57dd-bc02-4b8b-bfbf-94cd93f6ef49 service nova] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-48cee8f5-eb4c-40bf-9d9c-a356aaf3959d req-268a57dd-bc02-4b8b-bfbf-94cd93f6ef49 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-48cee8f5-eb4c-40bf-9d9c-a356aaf3959d req-268a57dd-bc02-4b8b-bfbf-94cd93f6ef49 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-48cee8f5-eb4c-40bf-9d9c-a356aaf3959d req-268a57dd-bc02-4b8b-bfbf-94cd93f6ef49 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] No waiting events found dispatching network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:01 user nova-compute[73158]: WARNING nova.compute.manager [req-48cee8f5-eb4c-40bf-9d9c-a356aaf3959d req-268a57dd-bc02-4b8b-bfbf-94cd93f6ef49 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received unexpected event network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d for instance with vm_state building and task_state spawning.
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267361.6171942, 055c448d-c4b7-4852-b331-fab5b760f925 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] VM Resumed (Lifecycle Event)
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Instance spawned successfully.
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267361.6191556, 055c448d-c4b7-4852-b331-fab5b760f925 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] VM Started (Lifecycle Event)
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 17 10:16:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:01 user nova-compute[73158]: INFO nova.compute.manager [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Took 7.00 seconds to build instance.
Aug 17 10:16:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e641e1c2-faf6-4f9d-b050-7fe33eae9a13 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "055c448d-c4b7-4852-b331-fab5b760f925" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.117s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:09 user nova-compute[73158]: INFO nova.compute.manager [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Terminating instance
Aug 17 10:16:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-610651c1-9313-4dc2-a681-4ce5dd1c211e req-35933307-4885-4bc3-b560-c2a772e91e53 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-vif-unplugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-610651c1-9313-4dc2-a681-4ce5dd1c211e req-35933307-4885-4bc3-b560-c2a772e91e53 service nova] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-610651c1-9313-4dc2-a681-4ce5dd1c211e req-35933307-4885-4bc3-b560-c2a772e91e53 service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-610651c1-9313-4dc2-a681-4ce5dd1c211e req-35933307-4885-4bc3-b560-c2a772e91e53 service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-610651c1-9313-4dc2-a681-4ce5dd1c211e req-35933307-4885-4bc3-b560-c2a772e91e53 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] No waiting events found dispatching network-vif-unplugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-610651c1-9313-4dc2-a681-4ce5dd1c211e req-35933307-4885-4bc3-b560-c2a772e91e53 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-vif-unplugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:16:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Instance destroyed successfully.
Aug 17 10:16:10 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lazy-loading 'resources' on Instance uuid 8775f432-db12-4e5f-b484-37a1922742a6 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-842428761',display_name='tempest-TestVolumeSwap-server-842428761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-842428761',id=8,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTiTJpbfP0XPozaajRd/KzR9icIRWvhS16HrBm0kQPzUUFN5zbAJXPt+NX6m6polaDOS7ig8XlX7OqRXjWSGJqm/4ifYsYZ4WkzjgOE+OEzOOEo0pJUNR0H7O7YcOIYVA==',key_name='tempest-keypair-1143540003',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a8f861aee784e1fac06d81b3b055859',ramdisk_id='',reservation_id='r-7jrqxtzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-160536066',owner_user_name='tempest-TestVolumeSwap-160536066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f22fc20f4d42c1a45bd2f17dcf2313',uuid=8775f432-db12-4e5f-b484-37a1922742a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Converting VIF {"id": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "address": "fa:16:3e:4f:6f:bd", "network": {"id": "4acd2c0b-2f0e-4371-8b21-b81e889d7c91", "bridge": "br-int", "label": "tempest-TestVolumeSwap-702508401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8f861aee784e1fac06d81b3b055859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077d1c5f-32", "ovs_interfaceid": "077d1c5f-3245-4d5b-851a-740deb1acbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG os_vif [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap077d1c5f-32, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:10 user nova-compute[73158]: INFO os_vif [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6f:bd,bridge_name='br-int',has_traffic_filtering=True,id=077d1c5f-3245-4d5b-851a-740deb1acbd5,network=Network(4acd2c0b-2f0e-4371-8b21-b81e889d7c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077d1c5f-32')
Aug 17 10:16:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Deleting instance files /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6_del
Aug 17 10:16:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Deletion of /opt/stack/data/nova/instances/8775f432-db12-4e5f-b484-37a1922742a6_del complete
Aug 17 10:16:10 user nova-compute[73158]: INFO nova.compute.manager [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 10:16:10 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:16:10 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:16:11 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Took 1.29 seconds to deallocate network for instance.
Aug 17 10:16:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-33590756-69e4-4096-9af1-e4493989796f req-ccf1236d-8c19-43a4-a70b-1d5b45111778 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-vif-deleted-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-43c4ea1c-225e-471f-a754-d22f2e986a20 req-754d65ea-f441-46f3-80a8-d15261b7d6a8 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received event network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-43c4ea1c-225e-471f-a754-d22f2e986a20 req-754d65ea-f441-46f3-80a8-d15261b7d6a8 service nova] Acquiring lock "8775f432-db12-4e5f-b484-37a1922742a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-43c4ea1c-225e-471f-a754-d22f2e986a20 req-754d65ea-f441-46f3-80a8-d15261b7d6a8 service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-43c4ea1c-225e-471f-a754-d22f2e986a20 req-754d65ea-f441-46f3-80a8-d15261b7d6a8 service nova] Lock "8775f432-db12-4e5f-b484-37a1922742a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-43c4ea1c-225e-471f-a754-d22f2e986a20 req-754d65ea-f441-46f3-80a8-d15261b7d6a8 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] No waiting events found dispatching network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:11 user nova-compute[73158]: WARNING nova.compute.manager [req-43c4ea1c-225e-471f-a754-d22f2e986a20 req-754d65ea-f441-46f3-80a8-d15261b7d6a8 service nova] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Received unexpected event network-vif-plugged-077d1c5f-3245-4d5b-851a-740deb1acbd5 for instance with vm_state deleted and task_state None.
Aug 17 10:16:12 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:16:12 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:16:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.675s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:12 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Deleted allocations for instance 8775f432-db12-4e5f-b484-37a1922742a6
Aug 17 10:16:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1c3b293e-c33d-48d3-a822-99198a3fa95c tempest-TestVolumeSwap-160536066 tempest-TestVolumeSwap-160536066-project-member] Lock "8775f432-db12-4e5f-b484-37a1922742a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.180s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:12 user nova-compute[73158]: INFO nova.compute.manager [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Rescuing
Aug 17 10:16:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:16:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:16:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:16:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:16:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:16:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance destroyed successfully.
Aug 17 10:16:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Attempting rescue
Aug 17 10:16:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73158) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:16:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Creating image(s)
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-498c25a4-ca52-4cc8-8da4-3cff675f554b req-b9d9b35d-e285-4abd-bd0f-9aa947558f10 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-498c25a4-ca52-4cc8-8da4-3cff675f554b req-b9d9b35d-e285-4abd-bd0f-9aa947558f10 service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-498c25a4-ca52-4cc8-8da4-3cff675f554b req-b9d9b35d-e285-4abd-bd0f-9aa947558f10 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-498c25a4-ca52-4cc8-8da4-3cff675f554b req-b9d9b35d-e285-4abd-bd0f-9aa947558f10 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-498c25a4-ca52-4cc8-8da4-3cff675f554b req-b9d9b35d-e285-4abd-bd0f-9aa947558f10 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:14 user nova-compute[73158]: WARNING nova.compute.manager [req-498c25a4-ca52-4cc8-8da4-3cff675f554b req-b9d9b35d-e285-4abd-bd0f-9aa947558f10 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state rescuing.
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.210s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue" returned: 0 in 0.077s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'migration_context' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Start _get_guest_xml network_info=[{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:3a:d0:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'resources' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'numa_topology' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-396406171',display_name='tempest-ServerRescueNegativeTestJSON-server-396406171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-396406171',id=1,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:11:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-z5t0kqwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:11:46Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=ca69a434-ae39-4400-a07f-b49c41f99e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:3a:d0:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:3a:d0:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'pci_devices' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:16:14 user nova-compute[73158]:   <uuid>ca69a434-ae39-4400-a07f-b49c41f99e84</uuid>
Aug 17 10:16:14 user nova-compute[73158]:   <name>instance-00000001</name>
Aug 17 10:16:14 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:16:14 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:16:14 user nova-compute[73158]:   <metadata>
Aug 17 10:16:14 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:16:14 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:16:14 user nova-compute[73158]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-396406171</nova:name>
Aug 17 10:16:14 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:16:14</nova:creationTime>
Aug 17 10:16:14 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:16:14 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:16:14 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:16:14 user nova-compute[73158]:       <nova:owner>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:user uuid="fc72634020f043308464eca253691603">tempest-ServerRescueNegativeTestJSON-1859456269-project-member</nova:user>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:project uuid="0eece5be982b434daf80b44ec022192e">tempest-ServerRescueNegativeTestJSON-1859456269</nova:project>
Aug 17 10:16:14 user nova-compute[73158]:       </nova:owner>
Aug 17 10:16:14 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:16:14 user nova-compute[73158]:       <nova:ports>
Aug 17 10:16:14 user nova-compute[73158]:         <nova:port uuid="9bd6daa1-d3d3-4ce7-99c4-c8f80474e061">
Aug 17 10:16:14 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 10:16:14 user nova-compute[73158]:         </nova:port>
Aug 17 10:16:14 user nova-compute[73158]:       </nova:ports>
Aug 17 10:16:14 user nova-compute[73158]:     </nova:instance>
Aug 17 10:16:14 user nova-compute[73158]:   </metadata>
Aug 17 10:16:14 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:16:14 user nova-compute[73158]:     <system>
Aug 17 10:16:14 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:16:14 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:16:14 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:16:14 user nova-compute[73158]:       <entry name="serial">ca69a434-ae39-4400-a07f-b49c41f99e84</entry>
Aug 17 10:16:14 user nova-compute[73158]:       <entry name="uuid">ca69a434-ae39-4400-a07f-b49c41f99e84</entry>
Aug 17 10:16:14 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:16:14 user nova-compute[73158]:     </system>
Aug 17 10:16:14 user nova-compute[73158]:   </sysinfo>
Aug 17 10:16:14 user nova-compute[73158]:   <os>
Aug 17 10:16:14 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:16:14 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:16:14 user nova-compute[73158]:   </os>
Aug 17 10:16:14 user nova-compute[73158]:   <features>
Aug 17 10:16:14 user nova-compute[73158]:     <acpi/>
Aug 17 10:16:14 user nova-compute[73158]:     <apic/>
Aug 17 10:16:14 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:16:14 user nova-compute[73158]:   </features>
Aug 17 10:16:14 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:16:14 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:16:14 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:16:14 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:16:14 user nova-compute[73158]:   </clock>
Aug 17 10:16:14 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:16:14 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:16:14 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:16:14 user nova-compute[73158]:   </cpu>
Aug 17 10:16:14 user nova-compute[73158]:   <devices>
Aug 17 10:16:14 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:16:14 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:16:14 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue"/>
Aug 17 10:16:14 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:16:14 user nova-compute[73158]:     </disk>
Aug 17 10:16:14 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:16:14 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:16:14 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk"/>
Aug 17 10:16:14 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:16:14 user nova-compute[73158]:     </disk>
Aug 17 10:16:14 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:16:14 user nova-compute[73158]:       <mac address="fa:16:3e:3a:d0:81"/>
Aug 17 10:16:14 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:16:14 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:16:14 user nova-compute[73158]:       <target dev="tap9bd6daa1-d3"/>
Aug 17 10:16:14 user nova-compute[73158]:     </interface>
Aug 17 10:16:14 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:16:14 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/console.log" append="off"/>
Aug 17 10:16:14 user nova-compute[73158]:     </serial>
Aug 17 10:16:14 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:16:14 user nova-compute[73158]:     <video>
Aug 17 10:16:14 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:16:14 user nova-compute[73158]:     </video>
Aug 17 10:16:14 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:16:14 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:16:14 user nova-compute[73158]:     </rng>
Aug 17 10:16:14 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:16:14 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:16:14 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:16:14 user nova-compute[73158]:     </memballoon>
Aug 17 10:16:14 user nova-compute[73158]:   </devices>
Aug 17 10:16:14 user nova-compute[73158]: </domain>
Aug 17 10:16:14 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:16:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance destroyed successfully.
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:16:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:3a:d0:81, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:16:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-7a321fea-fc79-43e7-8b9d-0275e2a676cc req-7f976009-782e-437b-892d-146268f16161 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a321fea-fc79-43e7-8b9d-0275e2a676cc req-7f976009-782e-437b-892d-146268f16161 service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a321fea-fc79-43e7-8b9d-0275e2a676cc req-7f976009-782e-437b-892d-146268f16161 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a321fea-fc79-43e7-8b9d-0275e2a676cc req-7f976009-782e-437b-892d-146268f16161 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-7a321fea-fc79-43e7-8b9d-0275e2a676cc req-7f976009-782e-437b-892d-146268f16161 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:16 user nova-compute[73158]: WARNING nova.compute.manager [req-7a321fea-fc79-43e7-8b9d-0275e2a676cc req-7f976009-782e-437b-892d-146268f16161 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state rescuing.
Aug 17 10:16:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:18 user nova-compute[73158]: WARNING nova.compute.manager [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state rescuing.
Aug 17 10:16:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:18 user nova-compute[73158]: WARNING nova.compute.manager [req-891d8cb3-01a9-4c18-aa8f-820258ed6b1d req-bb55f3e4-2f43-4144-ae95-a4d46c9c6b76 service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state rescuing.
Aug 17 10:16:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for ca69a434-ae39-4400-a07f-b49c41f99e84 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267379.0784447, ca69a434-ae39-4400-a07f-b49c41f99e84 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Resumed (Lifecycle Event)
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ae020c79-bf9e-4a38-a0f8-df4d3feebc00 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267379.080778, ca69a434-ae39-4400-a07f-b49c41f99e84 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Started (Lifecycle Event)
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 10:16:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:16:19 user nova-compute[73158]: INFO nova.compute.claims [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Claim successful on node user
Aug 17 10:16:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:16:20 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.policy [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bfd8d8513d24d0d893689d5db089546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbba4c18d534970a667590744f891a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:16:20 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Creating image(s)
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "/opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk 1073741824" returned: 0 in 0.082s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Cannot resize image /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'migration_context' on Instance uuid 300a9c6a-ed23-494d-8f26-9b5b333273f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Ensure instance console log exists: /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Successfully created port: 880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Successfully updated port: 880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-changed-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Refreshing instance network info cache due to event network-changed-880e03b0-c705-4878-ae9b-003626236587. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] Acquiring lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:16:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updating instance_info_cache with network_info: [{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Instance network_info: |[{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] Acquired lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.neutron [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Refreshing network info cache for port 880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Start _get_guest_xml network_info=[{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:16:23 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:23 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-335647070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-335647070',id=16,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-3hblmtv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:16:20Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=300a9c6a-ed23-494d-8f26-9b5b333273f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.objects.instance [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'pci_devices' on Instance uuid 300a9c6a-ed23-494d-8f26-9b5b333273f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:16:23 user nova-compute[73158]:   <uuid>300a9c6a-ed23-494d-8f26-9b5b333273f4</uuid>
Aug 17 10:16:23 user nova-compute[73158]:   <name>instance-00000010</name>
Aug 17 10:16:23 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:16:23 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:16:23 user nova-compute[73158]:   <metadata>
Aug 17 10:16:23 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:16:23 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:16:23 user nova-compute[73158]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-335647070</nova:name>
Aug 17 10:16:23 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:16:23</nova:creationTime>
Aug 17 10:16:23 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:16:23 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:16:23 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:16:23 user nova-compute[73158]:       <nova:owner>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:user uuid="9bfd8d8513d24d0d893689d5db089546">tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member</nova:user>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:project uuid="9bbba4c18d534970a667590744f891a2">tempest-ServerBootFromVolumeStableRescueTest-184800752</nova:project>
Aug 17 10:16:23 user nova-compute[73158]:       </nova:owner>
Aug 17 10:16:23 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:16:23 user nova-compute[73158]:       <nova:ports>
Aug 17 10:16:23 user nova-compute[73158]:         <nova:port uuid="880e03b0-c705-4878-ae9b-003626236587">
Aug 17 10:16:23 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 10:16:23 user nova-compute[73158]:         </nova:port>
Aug 17 10:16:23 user nova-compute[73158]:       </nova:ports>
Aug 17 10:16:23 user nova-compute[73158]:     </nova:instance>
Aug 17 10:16:23 user nova-compute[73158]:   </metadata>
Aug 17 10:16:23 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:16:23 user nova-compute[73158]:     <system>
Aug 17 10:16:23 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:16:23 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:16:23 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:16:23 user nova-compute[73158]:       <entry name="serial">300a9c6a-ed23-494d-8f26-9b5b333273f4</entry>
Aug 17 10:16:23 user nova-compute[73158]:       <entry name="uuid">300a9c6a-ed23-494d-8f26-9b5b333273f4</entry>
Aug 17 10:16:23 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:16:23 user nova-compute[73158]:     </system>
Aug 17 10:16:23 user nova-compute[73158]:   </sysinfo>
Aug 17 10:16:23 user nova-compute[73158]:   <os>
Aug 17 10:16:23 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:16:23 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:16:23 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:16:23 user nova-compute[73158]:   </os>
Aug 17 10:16:23 user nova-compute[73158]:   <features>
Aug 17 10:16:23 user nova-compute[73158]:     <acpi/>
Aug 17 10:16:23 user nova-compute[73158]:     <apic/>
Aug 17 10:16:23 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:16:23 user nova-compute[73158]:   </features>
Aug 17 10:16:23 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:16:23 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:16:23 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:16:23 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:16:23 user nova-compute[73158]:   </clock>
Aug 17 10:16:23 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:16:23 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:16:23 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:16:23 user nova-compute[73158]:   </cpu>
Aug 17 10:16:23 user nova-compute[73158]:   <devices>
Aug 17 10:16:23 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:16:23 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:16:23 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk"/>
Aug 17 10:16:23 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:16:23 user nova-compute[73158]:     </disk>
Aug 17 10:16:23 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:16:23 user nova-compute[73158]:       <mac address="fa:16:3e:8a:f8:e7"/>
Aug 17 10:16:23 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:16:23 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:16:23 user nova-compute[73158]:       <target dev="tap880e03b0-c7"/>
Aug 17 10:16:23 user nova-compute[73158]:     </interface>
Aug 17 10:16:23 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:16:23 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/console.log" append="off"/>
Aug 17 10:16:23 user nova-compute[73158]:     </serial>
Aug 17 10:16:23 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:16:23 user nova-compute[73158]:     <video>
Aug 17 10:16:23 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:16:23 user nova-compute[73158]:     </video>
Aug 17 10:16:23 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:16:23 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:16:23 user nova-compute[73158]:     </rng>
Aug 17 10:16:23 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:16:23 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:16:23 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:16:23 user nova-compute[73158]:     </memballoon>
Aug 17 10:16:23 user nova-compute[73158]:   </devices>
Aug 17 10:16:23 user nova-compute[73158]: </domain>
Aug 17 10:16:23 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-335647070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-335647070',id=16,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-3hblmtv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:16:20Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=300a9c6a-ed23-494d-8f26-9b5b333273f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG os_vif [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap880e03b0-c7, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap880e03b0-c7, col_values=(('external_ids', {'iface-id': '880e03b0-c705-4878-ae9b-003626236587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:f8:e7', 'vm-uuid': '300a9c6a-ed23-494d-8f26-9b5b333273f4'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:23 user nova-compute[73158]: INFO os_vif [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7')
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No VIF found with MAC fa:16:3e:8a:f8:e7, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.neutron [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updated VIF entry in instance network info cache for port 880e03b0-c705-4878-ae9b-003626236587. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG nova.network.neutron [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updating instance_info_cache with network_info: [{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:16:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b95e1e57-ab25-4417-b13a-dae3aebb88db req-e9732e1a-4317-430a-9815-be3473069b17 service nova] Releasing lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:16:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267370.0521388, 8775f432-db12-4e5f-b484-37a1922742a6 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:25 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] VM Stopped (Lifecycle Event)
Aug 17 10:16:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cda74e3c-9890-4487-8c78-8eccb4b1770b None None] [instance: 8775f432-db12-4e5f-b484-37a1922742a6] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b0651377-a2ce-4d92-912e-105d443e3389 req-da2ea4be-89d6-4a2a-893a-4341e0a9aa48 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b0651377-a2ce-4d92-912e-105d443e3389 req-da2ea4be-89d6-4a2a-893a-4341e0a9aa48 service nova] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b0651377-a2ce-4d92-912e-105d443e3389 req-da2ea4be-89d6-4a2a-893a-4341e0a9aa48 service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b0651377-a2ce-4d92-912e-105d443e3389 req-da2ea4be-89d6-4a2a-893a-4341e0a9aa48 service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b0651377-a2ce-4d92-912e-105d443e3389 req-da2ea4be-89d6-4a2a-893a-4341e0a9aa48 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] No waiting events found dispatching network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:25 user nova-compute[73158]: WARNING nova.compute.manager [req-b0651377-a2ce-4d92-912e-105d443e3389 req-da2ea4be-89d6-4a2a-893a-4341e0a9aa48 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received unexpected event network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 for instance with vm_state building and task_state spawning.
Aug 17 10:16:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267387.4465518, 300a9c6a-ed23-494d-8f26-9b5b333273f4 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] VM Resumed (Lifecycle Event)
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Instance spawned successfully.
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267387.4476457, 300a9c6a-ed23-494d-8f26-9b5b333273f4 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] VM Started (Lifecycle Event)
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-2ecf40dc-e6cc-4a99-9d7a-5df56d8809bb req-11f9b134-eb1d-4640-a2f0-24d5dae11b0d service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ecf40dc-e6cc-4a99-9d7a-5df56d8809bb req-11f9b134-eb1d-4640-a2f0-24d5dae11b0d service nova] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ecf40dc-e6cc-4a99-9d7a-5df56d8809bb req-11f9b134-eb1d-4640-a2f0-24d5dae11b0d service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ecf40dc-e6cc-4a99-9d7a-5df56d8809bb req-11f9b134-eb1d-4640-a2f0-24d5dae11b0d service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-2ecf40dc-e6cc-4a99-9d7a-5df56d8809bb req-11f9b134-eb1d-4640-a2f0-24d5dae11b0d service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] No waiting events found dispatching network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:27 user nova-compute[73158]: WARNING nova.compute.manager [req-2ecf40dc-e6cc-4a99-9d7a-5df56d8809bb req-11f9b134-eb1d-4640-a2f0-24d5dae11b0d service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received unexpected event network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 for instance with vm_state building and task_state spawning.
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Took 7.07 seconds to spawn the instance on the hypervisor.
Aug 17 10:16:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:27 user nova-compute[73158]: INFO nova.compute.manager [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Took 8.02 seconds to build instance.
Aug 17 10:16:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f7d12206-d3d2-4551-801e-6a9635469421 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.143s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:16:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:16:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7239MB free_disk=24.60503387451172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c3b24204-badc-4d40-9b96-5a8b07a49250 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f877b207-950b-4c69-9e6b-29e973f97a0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2cf001d-2354-463a-8683-e023222bfc9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6dbbeeed-8744-484d-bc7e-561a28305ec4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 055c448d-c4b7-4852-b331-fab5b760f925 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:16:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:16:50 user nova-compute[73158]: INFO nova.compute.claims [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Claim successful on node user
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:16:50 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:16:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:16:51 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Creating image(s)
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG nova.policy [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d012173c11e42e090143411f4d9f34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17cb60c0714fabb50a01bafaf56a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk 1073741824" returned: 0 in 0.059s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Cannot resize image /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:16:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'migration_context' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Successfully created port: 6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Ensure instance console log exists: /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Successfully updated port: 6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquired lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:16:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-changed-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Refreshing instance network info cache due to event network-changed-6a4f2143-f2bd-4467-a926-244b2dc8aedd. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] Acquiring lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.neutron [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Releasing lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Instance network_info: |[{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] Acquired lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Refreshing network info cache for port 6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Start _get_guest_xml network_info=[{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:16:53 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:53 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.objects.instance [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'pci_devices' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:16:53 user nova-compute[73158]:   <uuid>a43f242b-fdf6-4153-acad-344d28610631</uuid>
Aug 17 10:16:53 user nova-compute[73158]:   <name>instance-00000011</name>
Aug 17 10:16:53 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:16:53 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:16:53 user nova-compute[73158]:   <metadata>
Aug 17 10:16:53 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:16:53 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:16:53 user nova-compute[73158]:       <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:16:53 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:16:53</nova:creationTime>
Aug 17 10:16:53 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:16:53 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:16:53 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:16:53 user nova-compute[73158]:       <nova:owner>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:16:53 user nova-compute[73158]:       </nova:owner>
Aug 17 10:16:53 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:16:53 user nova-compute[73158]:       <nova:ports>
Aug 17 10:16:53 user nova-compute[73158]:         <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:16:53 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:16:53 user nova-compute[73158]:         </nova:port>
Aug 17 10:16:53 user nova-compute[73158]:       </nova:ports>
Aug 17 10:16:53 user nova-compute[73158]:     </nova:instance>
Aug 17 10:16:53 user nova-compute[73158]:   </metadata>
Aug 17 10:16:53 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:16:53 user nova-compute[73158]:     <system>
Aug 17 10:16:53 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:16:53 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:16:53 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:16:53 user nova-compute[73158]:       <entry name="serial">a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:16:53 user nova-compute[73158]:       <entry name="uuid">a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:16:53 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:16:53 user nova-compute[73158]:     </system>
Aug 17 10:16:53 user nova-compute[73158]:   </sysinfo>
Aug 17 10:16:53 user nova-compute[73158]:   <os>
Aug 17 10:16:53 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:16:53 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:16:53 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:16:53 user nova-compute[73158]:   </os>
Aug 17 10:16:53 user nova-compute[73158]:   <features>
Aug 17 10:16:53 user nova-compute[73158]:     <acpi/>
Aug 17 10:16:53 user nova-compute[73158]:     <apic/>
Aug 17 10:16:53 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:16:53 user nova-compute[73158]:   </features>
Aug 17 10:16:53 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:16:53 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:16:53 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:16:53 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:16:53 user nova-compute[73158]:   </clock>
Aug 17 10:16:53 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:16:53 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:16:53 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:16:53 user nova-compute[73158]:   </cpu>
Aug 17 10:16:53 user nova-compute[73158]:   <devices>
Aug 17 10:16:53 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:16:53 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:16:53 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk"/>
Aug 17 10:16:53 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:16:53 user nova-compute[73158]:     </disk>
Aug 17 10:16:53 user nova-compute[73158]:     <disk type="file" device="cdrom">
Aug 17 10:16:53 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 10:16:53 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config"/>
Aug 17 10:16:53 user nova-compute[73158]:       <target dev="hda" bus="ide"/>
Aug 17 10:16:53 user nova-compute[73158]:     </disk>
Aug 17 10:16:53 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:16:53 user nova-compute[73158]:       <mac address="fa:16:3e:ba:87:a1"/>
Aug 17 10:16:53 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:16:53 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:16:53 user nova-compute[73158]:       <target dev="tap6a4f2143-f2"/>
Aug 17 10:16:53 user nova-compute[73158]:     </interface>
Aug 17 10:16:53 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:16:53 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log" append="off"/>
Aug 17 10:16:53 user nova-compute[73158]:     </serial>
Aug 17 10:16:53 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:16:53 user nova-compute[73158]:     <video>
Aug 17 10:16:53 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:16:53 user nova-compute[73158]:     </video>
Aug 17 10:16:53 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:16:53 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:16:53 user nova-compute[73158]:     </rng>
Aug 17 10:16:53 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:16:53 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:16:53 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:16:53 user nova-compute[73158]:     </memballoon>
Aug 17 10:16:53 user nova-compute[73158]:   </devices>
Aug 17 10:16:53 user nova-compute[73158]: </domain>
Aug 17 10:16:53 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG os_vif [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a4f2143-f2, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a4f2143-f2, col_values=(('external_ids', {'iface-id': '6a4f2143-f2bd-4467-a926-244b2dc8aedd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:87:a1', 'vm-uuid': 'a43f242b-fdf6-4153-acad-344d28610631'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:53 user nova-compute[73158]: INFO os_vif [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2')
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No BDM found with device name hda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No VIF found with MAC fa:16:3e:ba:87:a1, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:16:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Using config drive
Aug 17 10:16:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Creating config drive at /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config
Aug 17 10:16:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8d7zsm_k {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8d7zsm_k" returned: 0 in 0.056s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updated VIF entry in instance network info cache for port 6a4f2143-f2bd-4467-a926-244b2dc8aedd. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:16:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7de902b8-6052-41ac-875e-328654217fae req-f1b372d0-aef8-4eb3-874b-73e85a6a04de service nova] Releasing lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-33ac3ee3-fe08-499e-9442-f5eb1a99cbf7 req-8aac93fd-7f46-45ff-8ff6-9ce3db3c70be service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-33ac3ee3-fe08-499e-9442-f5eb1a99cbf7 req-8aac93fd-7f46-45ff-8ff6-9ce3db3c70be service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-33ac3ee3-fe08-499e-9442-f5eb1a99cbf7 req-8aac93fd-7f46-45ff-8ff6-9ce3db3c70be service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-33ac3ee3-fe08-499e-9442-f5eb1a99cbf7 req-8aac93fd-7f46-45ff-8ff6-9ce3db3c70be service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-33ac3ee3-fe08-499e-9442-f5eb1a99cbf7 req-8aac93fd-7f46-45ff-8ff6-9ce3db3c70be service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:55 user nova-compute[73158]: WARNING nova.compute.manager [req-33ac3ee3-fe08-499e-9442-f5eb1a99cbf7 req-8aac93fd-7f46-45ff-8ff6-9ce3db3c70be service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd for instance with vm_state building and task_state spawning.
Aug 17 10:16:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267417.5923862, a43f242b-fdf6-4153-acad-344d28610631 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] VM Resumed (Lifecycle Event)
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] Instance spawned successfully.
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267417.5947938, a43f242b-fdf6-4153-acad-344d28610631 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] VM Started (Lifecycle Event)
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:16:57 user nova-compute[73158]: INFO nova.compute.manager [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Took 7.47 seconds to build instance.
Aug 17 10:16:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-381bc0a0-dfd7-4609-ac17-1a63133b6f33 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.618s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-9023c097-44b6-4c71-ba10-a329960cecb2 req-2cfebfc7-7900-4602-a43d-6eb4a2368788 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9023c097-44b6-4c71-ba10-a329960cecb2 req-2cfebfc7-7900-4602-a43d-6eb4a2368788 service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9023c097-44b6-4c71-ba10-a329960cecb2 req-2cfebfc7-7900-4602-a43d-6eb4a2368788 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9023c097-44b6-4c71-ba10-a329960cecb2 req-2cfebfc7-7900-4602-a43d-6eb4a2368788 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-9023c097-44b6-4c71-ba10-a329960cecb2 req-2cfebfc7-7900-4602-a43d-6eb4a2368788 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:57 user nova-compute[73158]: WARNING nova.compute.manager [req-9023c097-44b6-4c71-ba10-a329960cecb2 req-2cfebfc7-7900-4602-a43d-6eb4a2368788 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd for instance with vm_state active and task_state None.
Aug 17 10:16:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:59 user nova-compute[73158]: INFO nova.compute.manager [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Terminating instance
Aug 17 10:16:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-dbf5f692-6fe1-4a07-83c6-9a3c7f1f3f5f req-7790a27f-b716-47a2-8a48-eafbaf503091 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-unplugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-dbf5f692-6fe1-4a07-83c6-9a3c7f1f3f5f req-7790a27f-b716-47a2-8a48-eafbaf503091 service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-dbf5f692-6fe1-4a07-83c6-9a3c7f1f3f5f req-7790a27f-b716-47a2-8a48-eafbaf503091 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-dbf5f692-6fe1-4a07-83c6-9a3c7f1f3f5f req-7790a27f-b716-47a2-8a48-eafbaf503091 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-dbf5f692-6fe1-4a07-83c6-9a3c7f1f3f5f req-7790a27f-b716-47a2-8a48-eafbaf503091 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-unplugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:16:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-dbf5f692-6fe1-4a07-83c6-9a3c7f1f3f5f req-7790a27f-b716-47a2-8a48-eafbaf503091 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-unplugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:17:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Instance destroyed successfully.
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lazy-loading 'resources' on Instance uuid f877b207-950b-4c69-9e6b-29e973f97a0f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-469509928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1830998465',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp13s87YsSP5hXLXc3oT8gJDyNrfg0qxxuhSOTIUV/wq7nkQKQpqWZkXMVscmA9MWfKqzW6Zzzyd6dWMztqDvVyV/bCj1V6/KYCJfxNHY0Rts1QnrfR7feMD/5zrB3fOQ==',key_name='tempest-keypair-1685511148',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c1113c081e46ada5ee3a9ca5004d15',ramdisk_id='',reservation_id='r-jbslfto5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1012743389',owner_user_name='tempest-ServerActionsV293TestJSON-1012743389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d84e880a3e2f4707b3d58e353281fbd0',uuid=f877b207-950b-4c69-9e6b-29e973f97a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converting VIF {"id": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "address": "fa:16:3e:06:22:49", "network": {"id": "30a44806-16ad-4f11-b217-b91e71a7de89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1993950319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c1113c081e46ada5ee3a9ca5004d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21dff0-22", "ovs_interfaceid": "6f21dff0-22a2-431e-ab50-33b7956a0a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_vif [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f21dff0-22, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:00 user nova-compute[73158]: INFO os_vif [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:49,bridge_name='br-int',has_traffic_filtering=True,id=6f21dff0-22a2-431e-ab50-33b7956a0a5f,network=Network(30a44806-16ad-4f11-b217-b91e71a7de89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21dff0-22')
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfivLalV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:00 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471d1c3-e810-4a0c-8609-15b58f358280]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf6031c-cded-4f88-b3d1-10c3b136723d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:17:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 (non-flash)
Aug 17 10:17:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c162200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0'): ({'sdg'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Removing single pathed devices sdg {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa30257-c518-45f0-8f8b-c670286b5a10]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[115f357a-eafe-4127-b36d-90349f512d89]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Flushing IO for device /dev/sdg {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfec9516-673d-48a2-b97f-80d66f569370]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[10434362-e205-4baa-9855-3b431f2da3f9]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[22768d4b-9487-4267-9ddb-1c9e4eaacb2c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[39efab40-e435-4281-93c9-20b1a0201015]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260]
Aug 17 10:17:00 user nova-compute[73158]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0, portal: 172.16.0.220,3260] successful.
Aug 17 10:17:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8947c30-7d7a-4fa1-a4d6-21bab03655a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5979e5-2aa3-4b93-875b-5a31c628807d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] <== disconnect_volume: return (334ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:17:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Deleting instance files /opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f_del
Aug 17 10:17:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Deletion of /opt/stack/data/nova/instances/f877b207-950b-4c69-9e6b-29e973f97a0f_del complete
Aug 17 10:17:00 user nova-compute[73158]: INFO nova.compute.manager [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 17 10:17:00 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:17:00 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:17:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:01 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:01 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Took 0.93 seconds to deallocate network for instance.
Aug 17 10:17:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a00f68e-0a7d-4078-b655-7a1f1b5f49d5 req-4104343b-d507-49cd-af11-724720513f53 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-deleted-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:01 user nova-compute[73158]: INFO nova.compute.manager [req-3a00f68e-0a7d-4078-b655-7a1f1b5f49d5 req-4104343b-d507-49cd-af11-724720513f53 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Neutron deleted interface 6f21dff0-22a2-431e-ab50-33b7956a0a5f; detaching it from the instance and deleting it from the info cache
Aug 17 10:17:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-3a00f68e-0a7d-4078-b655-7a1f1b5f49d5 req-4104343b-d507-49cd-af11-724720513f53 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a00f68e-0a7d-4078-b655-7a1f1b5f49d5 req-4104343b-d507-49cd-af11-724720513f53 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Detach interface failed, port_id=6f21dff0-22a2-431e-ab50-33b7956a0a5f, reason: Instance f877b207-950b-4c69-9e6b-29e973f97a0f could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-b36f48ab-e51b-47c0-9955-34623a8ed97e req-b971c55b-d933-47e9-993a-9b99bfe26927 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b36f48ab-e51b-47c0-9955-34623a8ed97e req-b971c55b-d933-47e9-993a-9b99bfe26927 service nova] Acquiring lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b36f48ab-e51b-47c0-9955-34623a8ed97e req-b971c55b-d933-47e9-993a-9b99bfe26927 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b36f48ab-e51b-47c0-9955-34623a8ed97e req-b971c55b-d933-47e9-993a-9b99bfe26927 service nova] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-b36f48ab-e51b-47c0-9955-34623a8ed97e req-b971c55b-d933-47e9-993a-9b99bfe26927 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] No waiting events found dispatching network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:02 user nova-compute[73158]: WARNING nova.compute.manager [req-b36f48ab-e51b-47c0-9955-34623a8ed97e req-b971c55b-d933-47e9-993a-9b99bfe26927 service nova] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Received unexpected event network-vif-plugged-6f21dff0-22a2-431e-ab50-33b7956a0a5f for instance with vm_state active and task_state deleting.
Aug 17 10:17:02 user nova-compute[73158]: INFO nova.compute.manager [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Took 0.91 seconds to detach 1 volumes for instance.
Aug 17 10:17:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Deleting volume: e8947c30-7d7a-4fa1-a4d6-21bab03655a0 {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.852s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:03 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Deleted allocations for instance f877b207-950b-4c69-9e6b-29e973f97a0f
Aug 17 10:17:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aeeb3017-5de7-4e57-bc63-b17b48525da0 tempest-ServerActionsV293TestJSON-1012743389 tempest-ServerActionsV293TestJSON-1012743389-project-member] Lock "f877b207-950b-4c69-9e6b-29e973f97a0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.356s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "d2cf001d-2354-463a-8683-e023222bfc9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:06 user nova-compute[73158]: INFO nova.compute.manager [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Terminating instance
Aug 17 10:17:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-003f6b85-78c1-471d-a002-d98a39f271b9 req-a9e5eac8-7633-4b08-b489-ba2de01727ee service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-vif-unplugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-003f6b85-78c1-471d-a002-d98a39f271b9 req-a9e5eac8-7633-4b08-b489-ba2de01727ee service nova] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-003f6b85-78c1-471d-a002-d98a39f271b9 req-a9e5eac8-7633-4b08-b489-ba2de01727ee service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-003f6b85-78c1-471d-a002-d98a39f271b9 req-a9e5eac8-7633-4b08-b489-ba2de01727ee service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-003f6b85-78c1-471d-a002-d98a39f271b9 req-a9e5eac8-7633-4b08-b489-ba2de01727ee service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] No waiting events found dispatching network-vif-unplugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-003f6b85-78c1-471d-a002-d98a39f271b9 req-a9e5eac8-7633-4b08-b489-ba2de01727ee service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-vif-unplugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:17:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Instance destroyed successfully.
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'resources' on Instance uuid d2cf001d-2354-463a-8683-e023222bfc9b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1316682167',display_name='tempest-VolumesAdminNegativeTest-server-1316682167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1316682167',id=12,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc3a5e2269964313aa7a3a3d4d2e604f',ramdisk_id='',reservation_id='r-mxmepv4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1264923804',owner_user_name='tempest-VolumesAdminNegativeTest-1264923804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:15:14Z,user_data=None,user_id='a8cdcc95e0854d68a15db4d7e3d998e5',uuid=d2cf001d-2354-463a-8683-e023222bfc9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converting VIF {"id": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "address": "fa:16:3e:5e:ba:80", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b675d5a-b9", "ovs_interfaceid": "2b675d5a-b9f0-4235-8ef0-be54ff9bfb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG os_vif [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b675d5a-b9, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:07 user nova-compute[73158]: INFO os_vif [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ba:80,bridge_name='br-int',has_traffic_filtering=True,id=2b675d5a-b9f0-4235-8ef0-be54ff9bfb84,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b675d5a-b9')
Aug 17 10:17:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Deleting instance files /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b_del
Aug 17 10:17:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Deletion of /opt/stack/data/nova/instances/d2cf001d-2354-463a-8683-e023222bfc9b_del complete
Aug 17 10:17:07 user nova-compute[73158]: INFO nova.compute.manager [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 17 10:17:07 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:17:07 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:17:08 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:08 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Took 0.75 seconds to deallocate network for instance.
Aug 17 10:17:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:08 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:08 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Deleted allocations for instance d2cf001d-2354-463a-8683-e023222bfc9b
Aug 17 10:17:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3aa1fc94-db09-466d-bb36-c791ee43fe27 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "d2cf001d-2354-463a-8683-e023222bfc9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.430s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] Acquiring lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] Lock "d2cf001d-2354-463a-8683-e023222bfc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] No waiting events found dispatching network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:09 user nova-compute[73158]: WARNING nova.compute.manager [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received unexpected event network-vif-plugged-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 for instance with vm_state deleted and task_state None.
Aug 17 10:17:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-48f1717c-46a8-42a8-910f-b7ff99532899 req-03668381-7c6d-41c4-b0e3-e59491d1661f service nova] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Received event network-vif-deleted-2b675d5a-b9f0-4235-8ef0-be54ff9bfb84 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-changed-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Refreshing instance network info cache due to event network-changed-7be9163a-0c94-4891-8449-84d9a81abf29. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:17:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] Acquiring lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:17:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] Acquired lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:17:12 user nova-compute[73158]: DEBUG nova.network.neutron [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Refreshing network info cache for port 7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'flavor' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updated VIF entry in instance network info cache for port 7be9163a-0c94-4891-8449-84d9a81abf29. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating instance_info_cache with network_info: [{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-365f750f-761c-41a3-8583-53e7182d3e28 req-94d169ac-ca48-4954-aa1f-1d7ca0d25694 service nova] Releasing lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:13 user nova-compute[73158]: INFO nova.compute.manager [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attaching volume e842274a-20aa-4430-8a31-deb0ae81cc56 to /dev/vdb
Aug 17 10:17:13 user nova-compute[73158]: DEBUG os_brick.utils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[effe56c6-df76-424a-aa28-10e2daaf3d5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b228d6a2-6659-44a7-b478-61039bc97827]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c787d-0028-4a2b-a14c-19e636c057bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e229eb-f3dc-49a5-a535-f6c620dd1d7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:17:13 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:17:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2407c2c-9073-4fe8-85bc-1c127134e950]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG os_brick.utils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:13 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating existing volume attachment record: 486fc269-3e1d-4a81-9a17-05e705df9747 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:17:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:15 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267420.1520095, f877b207-950b-4c69-9e6b-29e973f97a0f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:15 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] VM Stopped (Lifecycle Event)
Aug 17 10:17:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-39332af2-789f-4191-be94-50d730b28265 None None] [instance: f877b207-950b-4c69-9e6b-29e973f97a0f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:17:18 user nova-compute[73158]: INFO nova.compute.claims [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Claim successful on node user
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:17:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:17:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:17:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:17:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Creating image(s)
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG nova.policy [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b067ceed67741b8acb93ab97ba02b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a300e5d1364d659313c9188a1edcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk 1073741824" returned: 0 in 0.053s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:17:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Cannot resize image /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'migration_context' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Ensure instance console log exists: /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Successfully created port: ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:17:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Skipping network cache update for instance because it is Building. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Successfully updated port: ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing instance network info cache due to event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:17:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267427.5008788, d2cf001d-2354-463a-8683-e023222bfc9b => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:22 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] VM Stopped (Lifecycle Event)
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-770e2cb3-c3b5-402d-ae80-fcda33ffb2c8 None None] [instance: d2cf001d-2354-463a-8683-e023222bfc9b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance network_info: |[{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.neutron [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Start _get_guest_xml network_info=[{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:22 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:17:22 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2006961583',display_name='tempest-ServerStableDeviceRescueTest-server-2006961583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2006961583',id=18,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYx+MQ9jBtSnlZpT+DBE6krXkBjkA+0nJFJbt+ICPaMhJLEuSMyfCwWGQShRsF1DLX9iM1onVAoHR1ebCKPgvBE/VMphZRpVv9fAB3AR1M1oLqMkZdCqH/nIVrz298Fw==',key_name='tempest-keypair-1238312178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26a300e5d1364d659313c9188a1edcf9',ramdisk_id='',reservation_id='r-b56pkd56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2030255454',owner_user_name='tempest-ServerStableDeviceRescueTest-2030255454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b067ceed67741b8acb93ab97ba02b66',uuid=a3e106ed-a561-4519-bff8-a911f5e46d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converting VIF {"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'pci_devices' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:17:22 user nova-compute[73158]:   <uuid>a3e106ed-a561-4519-bff8-a911f5e46d4b</uuid>
Aug 17 10:17:22 user nova-compute[73158]:   <name>instance-00000012</name>
Aug 17 10:17:22 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:17:22 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:17:22 user nova-compute[73158]:   <metadata>
Aug 17 10:17:22 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:17:22 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:17:22 user nova-compute[73158]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2006961583</nova:name>
Aug 17 10:17:22 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:17:22</nova:creationTime>
Aug 17 10:17:22 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:17:22 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:17:22 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:17:22 user nova-compute[73158]:       <nova:owner>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:user uuid="6b067ceed67741b8acb93ab97ba02b66">tempest-ServerStableDeviceRescueTest-2030255454-project-member</nova:user>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:project uuid="26a300e5d1364d659313c9188a1edcf9">tempest-ServerStableDeviceRescueTest-2030255454</nova:project>
Aug 17 10:17:22 user nova-compute[73158]:       </nova:owner>
Aug 17 10:17:22 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:17:22 user nova-compute[73158]:       <nova:ports>
Aug 17 10:17:22 user nova-compute[73158]:         <nova:port uuid="ac4b8c1e-6806-40ab-990f-4686051d1286">
Aug 17 10:17:22 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:17:22 user nova-compute[73158]:         </nova:port>
Aug 17 10:17:22 user nova-compute[73158]:       </nova:ports>
Aug 17 10:17:22 user nova-compute[73158]:     </nova:instance>
Aug 17 10:17:22 user nova-compute[73158]:   </metadata>
Aug 17 10:17:22 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:17:22 user nova-compute[73158]:     <system>
Aug 17 10:17:22 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:17:22 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:17:22 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:17:22 user nova-compute[73158]:       <entry name="serial">a3e106ed-a561-4519-bff8-a911f5e46d4b</entry>
Aug 17 10:17:22 user nova-compute[73158]:       <entry name="uuid">a3e106ed-a561-4519-bff8-a911f5e46d4b</entry>
Aug 17 10:17:22 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:17:22 user nova-compute[73158]:     </system>
Aug 17 10:17:22 user nova-compute[73158]:   </sysinfo>
Aug 17 10:17:22 user nova-compute[73158]:   <os>
Aug 17 10:17:22 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:17:22 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:17:22 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:17:22 user nova-compute[73158]:   </os>
Aug 17 10:17:22 user nova-compute[73158]:   <features>
Aug 17 10:17:22 user nova-compute[73158]:     <acpi/>
Aug 17 10:17:22 user nova-compute[73158]:     <apic/>
Aug 17 10:17:22 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:17:22 user nova-compute[73158]:   </features>
Aug 17 10:17:22 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:17:22 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:17:22 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:17:22 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:17:22 user nova-compute[73158]:   </clock>
Aug 17 10:17:22 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:17:22 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:17:22 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:17:22 user nova-compute[73158]:   </cpu>
Aug 17 10:17:22 user nova-compute[73158]:   <devices>
Aug 17 10:17:22 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:17:22 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:17:22 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk"/>
Aug 17 10:17:22 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:17:22 user nova-compute[73158]:     </disk>
Aug 17 10:17:22 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:17:22 user nova-compute[73158]:       <mac address="fa:16:3e:2c:e2:f5"/>
Aug 17 10:17:22 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:17:22 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:17:22 user nova-compute[73158]:       <target dev="tapac4b8c1e-68"/>
Aug 17 10:17:22 user nova-compute[73158]:     </interface>
Aug 17 10:17:22 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:17:22 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/console.log" append="off"/>
Aug 17 10:17:22 user nova-compute[73158]:     </serial>
Aug 17 10:17:22 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:17:22 user nova-compute[73158]:     <video>
Aug 17 10:17:22 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:17:22 user nova-compute[73158]:     </video>
Aug 17 10:17:22 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:17:22 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:17:22 user nova-compute[73158]:     </rng>
Aug 17 10:17:22 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:17:22 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:17:22 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:17:22 user nova-compute[73158]:     </memballoon>
Aug 17 10:17:22 user nova-compute[73158]:   </devices>
Aug 17 10:17:22 user nova-compute[73158]: </domain>
Aug 17 10:17:22 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2006961583',display_name='tempest-ServerStableDeviceRescueTest-server-2006961583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2006961583',id=18,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYx+MQ9jBtSnlZpT+DBE6krXkBjkA+0nJFJbt+ICPaMhJLEuSMyfCwWGQShRsF1DLX9iM1onVAoHR1ebCKPgvBE/VMphZRpVv9fAB3AR1M1oLqMkZdCqH/nIVrz298Fw==',key_name='tempest-keypair-1238312178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26a300e5d1364d659313c9188a1edcf9',ramdisk_id='',reservation_id='r-b56pkd56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2030255454',owner_user_name='tempest-ServerStableDeviceRescueTest-2030255454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b067ceed67741b8acb93ab97ba02b66',uuid=a3e106ed-a561-4519-bff8-a911f5e46d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converting VIF {"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG os_vif [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac4b8c1e-68, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac4b8c1e-68, col_values=(('external_ids', {'iface-id': 'ac4b8c1e-6806-40ab-990f-4686051d1286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:e2:f5', 'vm-uuid': 'a3e106ed-a561-4519-bff8-a911f5e46d4b'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:22 user nova-compute[73158]: INFO os_vif [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68')
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:17:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No VIF found with MAC fa:16:3e:2c:e2:f5, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG nova.network.neutron [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updated VIF entry in instance network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG nova.network.neutron [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c13903d8-f776-4999-8b5a-b4927f0a31a1 req-3f6ccc11-d4f6-422f-b0dd-8ce296e338b8 service nova] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:23 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-a5a2c8a2-177f-45a1-8a52-0c6576829c66 req-60ee6e5e-18be-41d5-9185-d109c2f151b7 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a5a2c8a2-177f-45a1-8a52-0c6576829c66 req-60ee6e5e-18be-41d5-9185-d109c2f151b7 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a5a2c8a2-177f-45a1-8a52-0c6576829c66 req-60ee6e5e-18be-41d5-9185-d109c2f151b7 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a5a2c8a2-177f-45a1-8a52-0c6576829c66 req-60ee6e5e-18be-41d5-9185-d109c2f151b7 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-a5a2c8a2-177f-45a1-8a52-0c6576829c66 req-60ee6e5e-18be-41d5-9185-d109c2f151b7 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:24 user nova-compute[73158]: WARNING nova.compute.manager [req-a5a2c8a2-177f-45a1-8a52-0c6576829c66 req-60ee6e5e-18be-41d5-9185-d109c2f151b7 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state building and task_state spawning.
Aug 17 10:17:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:25 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[97412351-4a13-4175-8635-6d0087d6d4e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:17:25 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[157a8073-67f5-46e6-b34b-7cd476744480]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56] added
Aug 17 10:17:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4daa5d-313e-4f94-8dd3-16ef42a65cdd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[23078f62-c44f-4c9f-a956-9bbf122f0ae2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHTDUYmt {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHTDUYmt" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c1624-5cb3-4be8-b9d2-8633d9ccf1cc]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHTDUYmt'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fde69f-4945-4ccd-8a99-4389a29a9407]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00259e-e75e-4679-b140-c261a712b8f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:17:25 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:17:25 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:17:25 user nova-compute[73158]: 
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd27759-5f3e-4531-94fa-11b7b0baed7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]
Aug 17 10:17:25 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.
Aug 17 10:17:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8008074-451b-4139-8e01-dfbd41d884fd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f407e48-ab96-4312-b308-0c9d0a208a20]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:17:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:17:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c381cc-2753-48e7-b9ed-3f606f7059c0]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267446.6502912, a3e106ed-a561-4519-bff8-a911f5e46d4b => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:26 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Resumed (Lifecycle Event)
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance spawned successfully.
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-34edc1d3-1e0c-435c-984d-5b3aa9e222e9 req-5333de0b-3c85-4dde-9fdc-09731da97b9e service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-34edc1d3-1e0c-435c-984d-5b3aa9e222e9 req-5333de0b-3c85-4dde-9fdc-09731da97b9e service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-34edc1d3-1e0c-435c-984d-5b3aa9e222e9 req-5333de0b-3c85-4dde-9fdc-09731da97b9e service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-34edc1d3-1e0c-435c-984d-5b3aa9e222e9 req-5333de0b-3c85-4dde-9fdc-09731da97b9e service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-34edc1d3-1e0c-435c-984d-5b3aa9e222e9 req-5333de0b-3c85-4dde-9fdc-09731da97b9e service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:26 user nova-compute[73158]: WARNING nova.compute.manager [req-34edc1d3-1e0c-435c-984d-5b3aa9e222e9 req-5333de0b-3c85-4dde-9fdc-09731da97b9e service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state building and task_state spawning.
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '26563636139623665', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563636139623665', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:17:26 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267446.6505914, a3e106ed-a561-4519-bff8-a911f5e46d4b => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:26 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Started (Lifecycle Event)
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'flavor' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:17:26 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:17:26 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:17:26 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:17:26 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:17:26 user nova-compute[73158]:   <serial>e842274a-20aa-4430-8a31-deb0ae81cc56</serial>
Aug 17 10:17:26 user nova-compute[73158]: </disk>
Aug 17 10:17:26 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:17:26 user nova-compute[73158]: INFO nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 17 10:17:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:27 user nova-compute[73158]: INFO nova.compute.manager [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Took 8.76 seconds to build instance.
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c4ba7723-39b0-4a70-95f5-b4efadfe80e1 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.904s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No VIF found with MAC fa:16:3e:f5:c3:be, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2e90b3d0-af8f-4948-816a-c62181e58794 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.884s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:28 user nova-compute[73158]: INFO nova.compute.manager [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Rebuilding instance
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_requests' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_devices' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'resources' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'migration_context' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73158) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-badf6efa-5177-4376-8894-5b07683cf782 req-eb910b75-b6c1-4a00-89fd-fb90aaf203ef service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-unplugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-badf6efa-5177-4376-8894-5b07683cf782 req-eb910b75-b6c1-4a00-89fd-fb90aaf203ef service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-badf6efa-5177-4376-8894-5b07683cf782 req-eb910b75-b6c1-4a00-89fd-fb90aaf203ef service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-badf6efa-5177-4376-8894-5b07683cf782 req-eb910b75-b6c1-4a00-89fd-fb90aaf203ef service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-badf6efa-5177-4376-8894-5b07683cf782 req-eb910b75-b6c1-4a00-89fd-fb90aaf203ef service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-unplugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:30 user nova-compute[73158]: WARNING nova.compute.manager [req-badf6efa-5177-4376-8894-5b07683cf782 req-eb910b75-b6c1-4a00-89fd-fb90aaf203ef service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-unplugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state active and task_state rebuilding.
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance destroyed successfully.
Aug 17 10:17:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:17:31 user nova-compute[73158]: INFO nova.compute.manager [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Detaching volume e842274a-20aa-4430-8a31-deb0ae81cc56
Aug 17 10:17:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:17:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7192MB free_disk=24.560894012451172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:31 user nova-compute[73158]: INFO nova.virt.block_device [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attempting to driver detach volume e842274a-20aa-4430-8a31-deb0ae81cc56 from mountpoint /dev/vdb
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Attempting to detach device vdb from instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:17:31 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:17:31 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:17:31 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:17:31 user nova-compute[73158]:   <serial>e842274a-20aa-4430-8a31-deb0ae81cc56</serial>
Aug 17 10:17:31 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:17:31 user nova-compute[73158]: </disk>
Aug 17 10:17:31 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:17:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully detached device vdb from instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f from the persistent domain config.
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:31 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a12d2f9-f925-4199-a632-92d2631b4f0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ed02f9-53cf-4319-944b-2713a05b51f7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:17:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:17:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c1af250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c3b24204-badc-4d40-9b96-5a8b07a49250 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6dbbeeed-8744-484d-bc7e-561a28305ec4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 055c448d-c4b7-4852-b331-fab5b760f925 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a43f242b-fdf6-4153-acad-344d28610631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a60cd6-00d4-443f-95ed-f66260cfac96]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b534b5e-2190-40b6-b7f6-e652bb103e93]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f1881-d7b3-442e-ad0f-d2d01d67a2ce]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b25f47-91a4-4cc9-bc81-dc542587798d]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[038eb384-7988-41c4-9248-f281ec4a044b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb38a9-3f25-4718-af7a-6854110891ca]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]
Aug 17 10:17:31 user nova-compute[73158]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.
Aug 17 10:17:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e9b57d-c72f-4199-adc7-41e56d4c8ad4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== disconnect_volume: return (321ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:17:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.compute.manager [req-09be24f3-4230-437f-b99d-12126bd22869 req-2ac33500-f781-47c9-bda9-00ae750b8291 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-09be24f3-4230-437f-b99d-12126bd22869 req-2ac33500-f781-47c9-bda9-00ae750b8291 service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-09be24f3-4230-437f-b99d-12126bd22869 req-2ac33500-f781-47c9-bda9-00ae750b8291 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-09be24f3-4230-437f-b99d-12126bd22869 req-2ac33500-f781-47c9-bda9-00ae750b8291 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.compute.manager [req-09be24f3-4230-437f-b99d-12126bd22869 req-2ac33500-f781-47c9-bda9-00ae750b8291 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:32 user nova-compute[73158]: WARNING nova.compute.manager [req-09be24f3-4230-437f-b99d-12126bd22869 req-2ac33500-f781-47c9-bda9-00ae750b8291 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state active and task_state rebuilding.
Aug 17 10:17:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:32 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance destroyed successfully.
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1073118539',display_name='tempest-ServerActionsTestOtherA-server-899659922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1073118539',id=13,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG4LLkTmKho7/DQkyMNHGblsl70hzP8HYWZF20OVinvBCArgUJTLIzfiZocc2B8phKSY8gneCeCgsuHYXDlUAabL2CpzyN29TsJEHurUvK+CymBK24Ui19oF18ADrR4nw==',key_name='tempest-keypair-1229036182',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:15:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-edr8e3uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be9163a-0c, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:32 user nova-compute[73158]: INFO os_vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c')
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:32 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e596d-de77-44ee-a760-dd215b2e85cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 17 10:17:32 user nova-compute[73158]: : NotImplementedError
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84efb13-8e79-497b-afff-ef180ba5e910]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:17:32 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:17:32 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:32 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:17:32 user nova-compute[73158]: : NotImplementedError
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c161750>, {}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Disconnecting from: [] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== disconnect_volume: return (47ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:17:32 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Deleting instance files /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f_del
Aug 17 10:17:32 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Deletion of /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f_del complete
Aug 17 10:17:32 user nova-compute[73158]: INFO nova.virt.block_device [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Booting with volume e842274a-20aa-4430-8a31-deb0ae81cc56 at /dev/vdb
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.utils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6491a393-2669-4ece-b196-510a2561df8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8a01fb-6c9f-4004-acb6-c12ebc369dbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f50b665-e762-4488-9db0-a0707489925a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b3451-0277-4ec0-b928-f340efe1add7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:17:32 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:17:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c0c04-4ac7-44a0-938b-b8ff4f36def6]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG os_brick.utils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:32 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating existing volume attachment record: 9fed0332-0184-4091-9d2e-56511817a506 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:17:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:17:38 user nova-compute[73158]: INFO nova.compute.claims [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Claim successful on node user
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:39 user nova-compute[73158]: INFO nova.compute.manager [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Terminating instance
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:17:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-6c7e0e5c-b5cf-49a1-9b62-08d9729feb0d req-ed7a34ca-1012-4718-a61c-01b7d57172c7 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-vif-unplugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6c7e0e5c-b5cf-49a1-9b62-08d9729feb0d req-ed7a34ca-1012-4718-a61c-01b7d57172c7 service nova] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6c7e0e5c-b5cf-49a1-9b62-08d9729feb0d req-ed7a34ca-1012-4718-a61c-01b7d57172c7 service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6c7e0e5c-b5cf-49a1-9b62-08d9729feb0d req-ed7a34ca-1012-4718-a61c-01b7d57172c7 service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-6c7e0e5c-b5cf-49a1-9b62-08d9729feb0d req-ed7a34ca-1012-4718-a61c-01b7d57172c7 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] No waiting events found dispatching network-vif-unplugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-6c7e0e5c-b5cf-49a1-9b62-08d9729feb0d req-ed7a34ca-1012-4718-a61c-01b7d57172c7 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-vif-unplugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.policy [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3434dc3b8af4c6dae565ddeb206e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7160dba7264083b524295f3d5028e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:17:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Creating image(s)
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.228s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Instance destroyed successfully.
Aug 17 10:17:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lazy-loading 'resources' on Instance uuid 6dbbeeed-8744-484d-bc7e-561a28305ec4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk 1073741824" returned: 0 in 0.069s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1747408933',display_name='tempest-VolumesNegativeTest-instance-1747408933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1747408933',id=14,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fbc5c66f0234a1d90ac3b6c97ebf690',ramdisk_id='',reservation_id='r-rjuob1hv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-160242110',owner_user_name='tempest-VolumesNegativeTest-160242110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:15:56Z,user_data=None,user_id='e43e55ab6d054c4f9c33c59d35b6c9b2',uuid=6dbbeeed-8744-484d-bc7e-561a28305ec4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Converting VIF {"id": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "address": "fa:16:3e:83:a5:ba", "network": {"id": "6990a3a5-3f0e-4a09-8a85-dceab7608bb5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae623923ea484fa397cfea70bb290968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf78f009c-a3", "ovs_interfaceid": "f78f009c-a362-470b-9133-2afe9ff8a6f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG os_vif [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf78f009c-a3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:40 user nova-compute[73158]: INFO os_vif [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a5:ba,bridge_name='br-int',has_traffic_filtering=True,id=f78f009c-a362-470b-9133-2afe9ff8a6f9,network=Network(6990a3a5-3f0e-4a09-8a85-dceab7608bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf78f009c-a3')
Aug 17 10:17:40 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Deleting instance files /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4_del
Aug 17 10:17:40 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Deletion of /opt/stack/data/nova/instances/6dbbeeed-8744-484d-bc7e-561a28305ec4_del complete
Aug 17 10:17:40 user nova-compute[73158]: INFO nova.compute.manager [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.231s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Cannot resize image /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'migration_context' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:40 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Successfully created port: 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-62861eba-ab99-4bde-a563-66b972cdfc94 req-72b74e8a-c931-4e60-87cd-7300cb03c804 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-vif-deleted-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:41 user nova-compute[73158]: INFO nova.compute.manager [req-62861eba-ab99-4bde-a563-66b972cdfc94 req-72b74e8a-c931-4e60-87cd-7300cb03c804 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Neutron deleted interface f78f009c-a362-470b-9133-2afe9ff8a6f9; detaching it from the instance and deleting it from the info cache
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.network.neutron [req-62861eba-ab99-4bde-a563-66b972cdfc94 req-72b74e8a-c931-4e60-87cd-7300cb03c804 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:41 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Took 1.11 seconds to deallocate network for instance.
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-62861eba-ab99-4bde-a563-66b972cdfc94 req-72b74e8a-c931-4e60-87cd-7300cb03c804 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Detach interface failed, port_id=f78f009c-a362-470b-9133-2afe9ff8a6f9, reason: Instance 6dbbeeed-8744-484d-bc7e-561a28305ec4 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-a31d4203-3ccc-41b7-8b93-773c93c42336 req-b4d86a38-ffee-47c3-ae89-0506a70bb975 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received event network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a31d4203-3ccc-41b7-8b93-773c93c42336 req-b4d86a38-ffee-47c3-ae89-0506a70bb975 service nova] Acquiring lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a31d4203-3ccc-41b7-8b93-773c93c42336 req-b4d86a38-ffee-47c3-ae89-0506a70bb975 service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a31d4203-3ccc-41b7-8b93-773c93c42336 req-b4d86a38-ffee-47c3-ae89-0506a70bb975 service nova] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-a31d4203-3ccc-41b7-8b93-773c93c42336 req-b4d86a38-ffee-47c3-ae89-0506a70bb975 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] No waiting events found dispatching network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:41 user nova-compute[73158]: WARNING nova.compute.manager [req-a31d4203-3ccc-41b7-8b93-773c93c42336 req-b4d86a38-ffee-47c3-ae89-0506a70bb975 service nova] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Received unexpected event network-vif-plugged-f78f009c-a362-470b-9133-2afe9ff8a6f9 for instance with vm_state deleted and task_state None.
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:41 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Deleted allocations for instance 6dbbeeed-8744-484d-bc7e-561a28305ec4
Aug 17 10:17:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-6e92dfe5-b0d4-49d7-b75f-48c6ff6ba738 tempest-VolumesNegativeTest-160242110 tempest-VolumesNegativeTest-160242110-project-member] Lock "6dbbeeed-8744-484d-bc7e-561a28305ec4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Successfully updated port: 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance network_info: |[{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start _get_guest_xml network_info=[{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:17:42 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:17:42 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:17:42 user nova-compute[73158]:   <uuid>4fe9c190-01f0-4d1c-af66-cd61aa8334ee</uuid>
Aug 17 10:17:42 user nova-compute[73158]:   <name>instance-00000013</name>
Aug 17 10:17:42 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:17:42 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:17:42 user nova-compute[73158]:   <metadata>
Aug 17 10:17:42 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:17:42 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:17:42 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherB-server-1669003801</nova:name>
Aug 17 10:17:42 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:17:42</nova:creationTime>
Aug 17 10:17:42 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:17:42 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:17:42 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:17:42 user nova-compute[73158]:       <nova:owner>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:user uuid="d3434dc3b8af4c6dae565ddeb206e201">tempest-ServerActionsTestOtherB-1114975532-project-member</nova:user>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:project uuid="9b7160dba7264083b524295f3d5028e8">tempest-ServerActionsTestOtherB-1114975532</nova:project>
Aug 17 10:17:42 user nova-compute[73158]:       </nova:owner>
Aug 17 10:17:42 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:17:42 user nova-compute[73158]:       <nova:ports>
Aug 17 10:17:42 user nova-compute[73158]:         <nova:port uuid="94d3ea77-5eb2-4eaf-b0e8-150394cce1a2">
Aug 17 10:17:42 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:17:42 user nova-compute[73158]:         </nova:port>
Aug 17 10:17:42 user nova-compute[73158]:       </nova:ports>
Aug 17 10:17:42 user nova-compute[73158]:     </nova:instance>
Aug 17 10:17:42 user nova-compute[73158]:   </metadata>
Aug 17 10:17:42 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:17:42 user nova-compute[73158]:     <system>
Aug 17 10:17:42 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:17:42 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:17:42 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:17:42 user nova-compute[73158]:       <entry name="serial">4fe9c190-01f0-4d1c-af66-cd61aa8334ee</entry>
Aug 17 10:17:42 user nova-compute[73158]:       <entry name="uuid">4fe9c190-01f0-4d1c-af66-cd61aa8334ee</entry>
Aug 17 10:17:42 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:17:42 user nova-compute[73158]:     </system>
Aug 17 10:17:42 user nova-compute[73158]:   </sysinfo>
Aug 17 10:17:42 user nova-compute[73158]:   <os>
Aug 17 10:17:42 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:17:42 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:17:42 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:17:42 user nova-compute[73158]:   </os>
Aug 17 10:17:42 user nova-compute[73158]:   <features>
Aug 17 10:17:42 user nova-compute[73158]:     <acpi/>
Aug 17 10:17:42 user nova-compute[73158]:     <apic/>
Aug 17 10:17:42 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:17:42 user nova-compute[73158]:   </features>
Aug 17 10:17:42 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:17:42 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:17:42 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:17:42 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:17:42 user nova-compute[73158]:   </clock>
Aug 17 10:17:42 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:17:42 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:17:42 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:17:42 user nova-compute[73158]:   </cpu>
Aug 17 10:17:42 user nova-compute[73158]:   <devices>
Aug 17 10:17:42 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:17:42 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:17:42 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk"/>
Aug 17 10:17:42 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:17:42 user nova-compute[73158]:     </disk>
Aug 17 10:17:42 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:17:42 user nova-compute[73158]:       <mac address="fa:16:3e:80:1e:65"/>
Aug 17 10:17:42 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:17:42 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:17:42 user nova-compute[73158]:       <target dev="tap94d3ea77-5e"/>
Aug 17 10:17:42 user nova-compute[73158]:     </interface>
Aug 17 10:17:42 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:17:42 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/console.log" append="off"/>
Aug 17 10:17:42 user nova-compute[73158]:     </serial>
Aug 17 10:17:42 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:17:42 user nova-compute[73158]:     <video>
Aug 17 10:17:42 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:17:42 user nova-compute[73158]:     </video>
Aug 17 10:17:42 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:17:42 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:17:42 user nova-compute[73158]:     </rng>
Aug 17 10:17:42 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:17:42 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:17:42 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:17:42 user nova-compute[73158]:     </memballoon>
Aug 17 10:17:42 user nova-compute[73158]:   </devices>
Aug 17 10:17:42 user nova-compute[73158]: </domain>
Aug 17 10:17:42 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG os_vif [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94d3ea77-5e, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94d3ea77-5e, col_values=(('external_ids', {'iface-id': '94d3ea77-5eb2-4eaf-b0e8-150394cce1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:1e:65', 'vm-uuid': '4fe9c190-01f0-4d1c-af66-cd61aa8334ee'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:42 user nova-compute[73158]: INFO os_vif [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e')
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:17:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No VIF found with MAC fa:16:3e:80:1e:65, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-changed-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Refreshing instance network info cache due to event network-changed-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG nova.network.neutron [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Refreshing network info cache for port 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG nova.network.neutron [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updated VIF entry in instance network info cache for port 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG nova.network.neutron [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f52de852-0fd4-4e53-b21f-2e3a42bd25d5 req-c817e8ef-a4d2-4b6f-9996-d21e27f85452 service nova] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-021e4596-4399-408a-96a1-b6ce2574f980 req-a100ad1a-cf08-4435-82df-ba9708a0a077 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-021e4596-4399-408a-96a1-b6ce2574f980 req-a100ad1a-cf08-4435-82df-ba9708a0a077 service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-021e4596-4399-408a-96a1-b6ce2574f980 req-a100ad1a-cf08-4435-82df-ba9708a0a077 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-021e4596-4399-408a-96a1-b6ce2574f980 req-a100ad1a-cf08-4435-82df-ba9708a0a077 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-021e4596-4399-408a-96a1-b6ce2574f980 req-a100ad1a-cf08-4435-82df-ba9708a0a077 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:44 user nova-compute[73158]: WARNING nova.compute.manager [req-021e4596-4399-408a-96a1-b6ce2574f980 req-a100ad1a-cf08-4435-82df-ba9708a0a077 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state building and task_state spawning.
Aug 17 10:17:44 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:17:44 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Creating image(s)
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk 1073741824" returned: 0 in 0.050s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:17:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Cannot resize image /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Ensure instance console log exists: /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Start _get_guest_xml network_info=[{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '9fed0332-0184-4091-9d2e-56511817a506', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e842274a-20aa-4430-8a31-deb0ae81cc56', 'serial': 'e842274a-20aa-4430-8a31-deb0ae81cc56'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:17:45 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 10:17:45 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:17:45 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:45 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:17:45 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2f30dc-1057-4e39-a04a-641770ce9f9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:17:45 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae373c-a92e-48cf-8f6b-12e86e899dc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56] added
Aug 17 10:17:45 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f289b0ac-9dfb-499c-81f1-af3c671037b8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5508445-8677-4b93-a790-efcbf1f8bf7a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHTDUYmt {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHTDUYmt" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9009e4-c3ae-4e88-aea1-2a8fec45cca3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHTDUYmt'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d989f0-8f3f-410b-a746-ed872f0584de]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "055c448d-c4b7-4852-b331-fab5b760f925" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267450.4254377, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:45 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] VM Stopped (Lifecycle Event)
Aug 17 10:17:45 user nova-compute[73158]: INFO nova.compute.manager [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Terminating instance
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d447a687-9a05-4dfd-a04f-e9e75420ad6a None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d051a9-c876-4795-9c36-07d60d48c104]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:17:45 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:17:45 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:45 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:17:45 user nova-compute[73158]: : NotImplementedError
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce795b97-3d56-491b-9c15-bae9d1fb4214]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]
Aug 17 10:17:45 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.
Aug 17 10:17:45 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9646c6f-2d99-4bee-a12f-5c7fc4ef4347]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5045c0c1-d4a1-45f6-98b2-5c20ba445dff]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:17:45 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:17:45 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e128eaa-d537-45eb-8176-d73a537693fb]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:17:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Instance destroyed successfully.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lazy-loading 'resources' on Instance uuid 055c448d-c4b7-4852-b331-fab5b760f925 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-248707735',display_name='tempest-VolumesActionsTest-instance-248707735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-248707735',id=15,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07223795d5094ee1b75158a794497264',ramdisk_id='',reservation_id='r-bvb2jvo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1130727858',owner_user_name='tempest-VolumesActionsTest-1130727858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:02Z,user_data=None,user_id='cbecf64518ba437895e7816c5ad54b9d',uuid=055c448d-c4b7-4852-b331-fab5b760f925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converting VIF {"id": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "address": "fa:16:3e:2d:07:4b", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape776cd07-13", "ovs_interfaceid": "e776cd07-1380-4b9c-8606-18f24aeaa59d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG os_vif [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape776cd07-13, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:46 user nova-compute[73158]: INFO os_vif [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=e776cd07-1380-4b9c-8606-18f24aeaa59d,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape776cd07-13')
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Deleting instance files /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925_del
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Deletion of /opt/stack/data/nova/instances/055c448d-c4b7-4852-b331-fab5b760f925_del complete
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267466.1223986, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Resumed (Lifecycle Event)
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance spawned successfully.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:46 user nova-compute[73158]: WARNING nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state building and task_state spawning.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-vif-unplugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] No waiting events found dispatching network-vif-unplugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-vif-unplugged-e776cd07-1380-4b9c-8606-18f24aeaa59d for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Acquiring lock "055c448d-c4b7-4852-b331-fab5b760f925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] Lock "055c448d-c4b7-4852-b331-fab5b760f925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] No waiting events found dispatching network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:46 user nova-compute[73158]: WARNING nova.compute.manager [req-4c8e09d0-0a36-4e68-a771-c04a72e0f5b6 req-305a2f7a-7923-42d2-a437-35f4c29e22e6 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received unexpected event network-vif-plugged-e776cd07-1380-4b9c-8606-18f24aeaa59d for instance with vm_state active and task_state deleting.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267466.1274729, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Started (Lifecycle Event)
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Took 6.82 seconds to spawn the instance on the hypervisor.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Took 7.84 seconds to build instance.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7503209b-0869-44ca-8c53-517b9736466d tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.942s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26563636139623665', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563636139623665', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1073118539',display_name='tempest-ServerActionsTestOtherA-server-899659922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1073118539',id=13,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG4LLkTmKho7/DQkyMNHGblsl70hzP8HYWZF20OVinvBCArgUJTLIzfiZocc2B8phKSY8gneCeCgsuHYXDlUAabL2CpzyN29TsJEHurUvK+CymBK24Ui19oF18ADrR4nw==',key_name='tempest-keypair-1229036182',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:15:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-edr8e3uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:17:46 user nova-compute[73158]:   <uuid>d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f</uuid>
Aug 17 10:17:46 user nova-compute[73158]:   <name>instance-0000000d</name>
Aug 17 10:17:46 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:17:46 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:17:46 user nova-compute[73158]:   <metadata>
Aug 17 10:17:46 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:17:46 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:17:46 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherA-server-899659922</nova:name>
Aug 17 10:17:46 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:17:45</nova:creationTime>
Aug 17 10:17:46 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:17:46 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:17:46 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:17:46 user nova-compute[73158]:       <nova:owner>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:user uuid="a6db6c1120b74ffbb1bf354c509d27ec">tempest-ServerActionsTestOtherA-1163059526-project-member</nova:user>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:project uuid="44597afe7d404702983ba1555116e936">tempest-ServerActionsTestOtherA-1163059526</nova:project>
Aug 17 10:17:46 user nova-compute[73158]:       </nova:owner>
Aug 17 10:17:46 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:17:46 user nova-compute[73158]:       <nova:ports>
Aug 17 10:17:46 user nova-compute[73158]:         <nova:port uuid="7be9163a-0c94-4891-8449-84d9a81abf29">
Aug 17 10:17:46 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 10:17:46 user nova-compute[73158]:         </nova:port>
Aug 17 10:17:46 user nova-compute[73158]:       </nova:ports>
Aug 17 10:17:46 user nova-compute[73158]:     </nova:instance>
Aug 17 10:17:46 user nova-compute[73158]:   </metadata>
Aug 17 10:17:46 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:17:46 user nova-compute[73158]:     <system>
Aug 17 10:17:46 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:17:46 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:17:46 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:17:46 user nova-compute[73158]:       <entry name="serial">d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f</entry>
Aug 17 10:17:46 user nova-compute[73158]:       <entry name="uuid">d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f</entry>
Aug 17 10:17:46 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:17:46 user nova-compute[73158]:     </system>
Aug 17 10:17:46 user nova-compute[73158]:   </sysinfo>
Aug 17 10:17:46 user nova-compute[73158]:   <os>
Aug 17 10:17:46 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:17:46 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:17:46 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:17:46 user nova-compute[73158]:   </os>
Aug 17 10:17:46 user nova-compute[73158]:   <features>
Aug 17 10:17:46 user nova-compute[73158]:     <acpi/>
Aug 17 10:17:46 user nova-compute[73158]:     <apic/>
Aug 17 10:17:46 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:17:46 user nova-compute[73158]:   </features>
Aug 17 10:17:46 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:17:46 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:17:46 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:17:46 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:17:46 user nova-compute[73158]:   </clock>
Aug 17 10:17:46 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:17:46 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:17:46 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:17:46 user nova-compute[73158]:   </cpu>
Aug 17 10:17:46 user nova-compute[73158]:   <devices>
Aug 17 10:17:46 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:17:46 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:17:46 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk"/>
Aug 17 10:17:46 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:17:46 user nova-compute[73158]:     </disk>
Aug 17 10:17:46 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:17:46 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:17:46 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:17:46 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:17:46 user nova-compute[73158]:       <serial>e842274a-20aa-4430-8a31-deb0ae81cc56</serial>
Aug 17 10:17:46 user nova-compute[73158]:     </disk>
Aug 17 10:17:46 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:17:46 user nova-compute[73158]:       <mac address="fa:16:3e:f5:c3:be"/>
Aug 17 10:17:46 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:17:46 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:17:46 user nova-compute[73158]:       <target dev="tap7be9163a-0c"/>
Aug 17 10:17:46 user nova-compute[73158]:     </interface>
Aug 17 10:17:46 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:17:46 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/console.log" append="off"/>
Aug 17 10:17:46 user nova-compute[73158]:     </serial>
Aug 17 10:17:46 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:17:46 user nova-compute[73158]:     <video>
Aug 17 10:17:46 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:17:46 user nova-compute[73158]:     </video>
Aug 17 10:17:46 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:17:46 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:17:46 user nova-compute[73158]:     </rng>
Aug 17 10:17:46 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:17:46 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:17:46 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:17:46 user nova-compute[73158]:     </memballoon>
Aug 17 10:17:46 user nova-compute[73158]:   </devices>
Aug 17 10:17:46 user nova-compute[73158]: </domain>
Aug 17 10:17:46 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1073118539',display_name='tempest-ServerActionsTestOtherA-server-899659922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1073118539',id=13,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG4LLkTmKho7/DQkyMNHGblsl70hzP8HYWZF20OVinvBCArgUJTLIzfiZocc2B8phKSY8gneCeCgsuHYXDlUAabL2CpzyN29TsJEHurUvK+CymBK24Ui19oF18ADrR4nw==',key_name='tempest-keypair-1229036182',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:15:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-edr8e3uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG os_vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Took 0.52 seconds to deallocate network for instance.
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4e3d3d3f-5a9d-44f3-9314-e24462ca3ec3 req-e61a2482-78b4-47fd-88f9-f9d61229e5b4 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Received event network-vif-deleted-e776cd07-1380-4b9c-8606-18f24aeaa59d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:46 user nova-compute[73158]: INFO nova.compute.manager [req-4e3d3d3f-5a9d-44f3-9314-e24462ca3ec3 req-e61a2482-78b4-47fd-88f9-f9d61229e5b4 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Neutron deleted interface e776cd07-1380-4b9c-8606-18f24aeaa59d; detaching it from the instance and deleting it from the info cache
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.network.neutron [req-4e3d3d3f-5a9d-44f3-9314-e24462ca3ec3 req-e61a2482-78b4-47fd-88f9-f9d61229e5b4 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be9163a-0c, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7be9163a-0c, col_values=(('external_ids', {'iface-id': '7be9163a-0c94-4891-8449-84d9a81abf29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c3:be', 'vm-uuid': 'd6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-4e3d3d3f-5a9d-44f3-9314-e24462ca3ec3 req-e61a2482-78b4-47fd-88f9-f9d61229e5b4 service nova] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Detach interface failed, port_id=e776cd07-1380-4b9c-8606-18f24aeaa59d, reason: Instance 055c448d-c4b7-4852-b331-fab5b760f925 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:46 user nova-compute[73158]: INFO os_vif [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c')
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:17:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No VIF found with MAC fa:16:3e:f5:c3:be, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:17:47 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:17:47 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:17:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:47 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Deleted allocations for instance 055c448d-c4b7-4852-b331-fab5b760f925
Aug 17 10:17:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4c937840-8225-42e0-9669-243c28701325 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "055c448d-c4b7-4852-b331-fab5b760f925" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7002ddb-6de9-4af7-841d-c159884ccfdc req-05daf6de-c0c9-4cac-bb07-57bd4261d2e1 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7002ddb-6de9-4af7-841d-c159884ccfdc req-05daf6de-c0c9-4cac-bb07-57bd4261d2e1 service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7002ddb-6de9-4af7-841d-c159884ccfdc req-05daf6de-c0c9-4cac-bb07-57bd4261d2e1 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7002ddb-6de9-4af7-841d-c159884ccfdc req-05daf6de-c0c9-4cac-bb07-57bd4261d2e1 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7002ddb-6de9-4af7-841d-c159884ccfdc req-05daf6de-c0c9-4cac-bb07-57bd4261d2e1 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:48 user nova-compute[73158]: WARNING nova.compute.manager [req-f7002ddb-6de9-4af7-841d-c159884ccfdc req-05daf6de-c0c9-4cac-bb07-57bd4261d2e1 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-fa29c62a-6f86-4d4a-9a78-0a5a9e11029d req-300a404c-317c-4a33-8d01-645ef13604ff service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fa29c62a-6f86-4d4a-9a78-0a5a9e11029d req-300a404c-317c-4a33-8d01-645ef13604ff service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fa29c62a-6f86-4d4a-9a78-0a5a9e11029d req-300a404c-317c-4a33-8d01-645ef13604ff service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fa29c62a-6f86-4d4a-9a78-0a5a9e11029d req-300a404c-317c-4a33-8d01-645ef13604ff service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-fa29c62a-6f86-4d4a-9a78-0a5a9e11029d req-300a404c-317c-4a33-8d01-645ef13604ff service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:17:50 user nova-compute[73158]: WARNING nova.compute.manager [req-fa29c62a-6f86-4d4a-9a78-0a5a9e11029d req-300a404c-317c-4a33-8d01-645ef13604ff service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267470.7033868, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:50 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] VM Resumed (Lifecycle Event)
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:17:50 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance spawned successfully.
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:17:50 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267470.70484, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:50 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] VM Started (Lifecycle Event)
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:17:50 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:17:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73158) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 10:17:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-41e6135d-ed09-40a6-a478-aa6b3eff8f94 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:17:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:54 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267459.9258687, 6dbbeeed-8744-484d-bc7e-561a28305ec4 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:17:54 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] VM Stopped (Lifecycle Event)
Aug 17 10:17:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-38570514-cef6-4dfb-b1d4-d89c1c234d39 None None] [instance: 6dbbeeed-8744-484d-bc7e-561a28305ec4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:17:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:17:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:01 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267466.014257, 055c448d-c4b7-4852-b331-fab5b760f925 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:01 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] VM Stopped (Lifecycle Event)
Aug 17 10:18:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-9fa36ed9-45ae-40b2-9bda-a2cfe1cd1823 None None] [instance: 055c448d-c4b7-4852-b331-fab5b760f925] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:03 user nova-compute[73158]: INFO nova.compute.manager [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Terminating instance
Aug 17 10:18:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: INFO nova.compute.manager [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Unrescuing
Aug 17 10:18:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-73d213cc-49a7-44c9-b208-4e4d11b6b01f req-bc40e03c-f43d-47f4-999f-a8870cb49b8f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-unplugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73d213cc-49a7-44c9-b208-4e4d11b6b01f req-bc40e03c-f43d-47f4-999f-a8870cb49b8f service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73d213cc-49a7-44c9-b208-4e4d11b6b01f req-bc40e03c-f43d-47f4-999f-a8870cb49b8f service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73d213cc-49a7-44c9-b208-4e4d11b6b01f req-bc40e03c-f43d-47f4-999f-a8870cb49b8f service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-73d213cc-49a7-44c9-b208-4e4d11b6b01f req-bc40e03c-f43d-47f4-999f-a8870cb49b8f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-unplugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-73d213cc-49a7-44c9-b208-4e4d11b6b01f req-bc40e03c-f43d-47f4-999f-a8870cb49b8f service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-unplugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Instance destroyed successfully.
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lazy-loading 'resources' on Instance uuid c3b24204-badc-4d40-9b96-5a8b07a49250 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1731755005',display_name='tempest-VolumesAdminNegativeTest-server-1731755005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1731755005',id=7,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbKpon8Q2vw3LAN3SWPZV/UXKCYVS0/vEGGAwJLSYQptFTTqIjg1GxceK0fzUK/fZYNGUYUPyYVm4X4WfFWFtc8uL5h6IaXh4hF2U2uEP6ShyA/QZu6b3C8+1nQ6BACuw==',key_name='tempest-keypair-1794708543',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc3a5e2269964313aa7a3a3d4d2e604f',ramdisk_id='',reservation_id='r-yhjgv6nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1264923804',owner_user_name='tempest-VolumesAdminNegativeTest-1264923804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8cdcc95e0854d68a15db4d7e3d998e5',uuid=c3b24204-badc-4d40-9b96-5a8b07a49250,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converting VIF {"id": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "address": "fa:16:3e:f2:fc:29", "network": {"id": "22205b65-effe-4b94-9952-e7a129c37b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-26599749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3a5e2269964313aa7a3a3d4d2e604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6281f6ca-0a", "ovs_interfaceid": "6281f6ca-0a00-45f8-907c-1e228b9eccae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG os_vif [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6281f6ca-0a, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:04 user nova-compute[73158]: INFO os_vif [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=6281f6ca-0a00-45f8-907c-1e228b9eccae,network=Network(22205b65-effe-4b94-9952-e7a129c37b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6281f6ca-0a')
Aug 17 10:18:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Deleting instance files /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250_del
Aug 17 10:18:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Deletion of /opt/stack/data/nova/instances/c3b24204-badc-4d40-9b96-5a8b07a49250_del complete
Aug 17 10:18:04 user nova-compute[73158]: INFO nova.compute.manager [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 10:18:04 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:18:04 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'flavor' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance destroyed successfully.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-36ee5a51-22e2-45ab-9268-69a6ca4d9a42 req-c6684b6f-25bc-439e-88a0-d6d980325cba service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-deleted-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:06 user nova-compute[73158]: INFO nova.compute.manager [req-36ee5a51-22e2-45ab-9268-69a6ca4d9a42 req-c6684b6f-25bc-439e-88a0-d6d980325cba service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Neutron deleted interface 6281f6ca-0a00-45f8-907c-1e228b9eccae; detaching it from the instance and deleting it from the info cache
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-36ee5a51-22e2-45ab-9268-69a6ca4d9a42 req-c6684b6f-25bc-439e-88a0-d6d980325cba service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:06 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Took 1.73 seconds to deallocate network for instance.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-36ee5a51-22e2-45ab-9268-69a6ca4d9a42 req-c6684b6f-25bc-439e-88a0-d6d980325cba service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Detach interface failed, port_id=6281f6ca-0a00-45f8-907c-1e228b9eccae, reason: Instance c3b24204-badc-4d40-9b96-5a8b07a49250 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:06 user nova-compute[73158]: WARNING nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state deleted and task_state None.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:06 user nova-compute[73158]: WARNING nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state deleted and task_state None.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:06 user nova-compute[73158]: WARNING nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state deleted and task_state None.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-unplugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-unplugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:06 user nova-compute[73158]: WARNING nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-unplugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state deleted and task_state None.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Acquiring lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] No waiting events found dispatching network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:06 user nova-compute[73158]: WARNING nova.compute.manager [req-f518f6ba-1a4d-4c0d-95b6-b17d8aa4b498 req-95fc416a-0e2f-4d48-a04a-5e0ca1e670d6 service nova] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Received unexpected event network-vif-plugged-6281f6ca-0a00-45f8-907c-1e228b9eccae for instance with vm_state deleted and task_state None.
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:07 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Deleted allocations for instance c3b24204-badc-4d40-9b96-5a8b07a49250
Aug 17 10:18:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:18:07 user nova-compute[73158]: INFO nova.compute.claims [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Claim successful on node user
Aug 17 10:18:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8de6c083-5520-438b-b4a7-0c60498898e3 tempest-VolumesAdminNegativeTest-1264923804 tempest-VolumesAdminNegativeTest-1264923804-project-member] Lock "c3b24204-badc-4d40-9b96-5a8b07a49250" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.426s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.network.neutron [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:18:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG nova.policy [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1978c81194804f6cbd5e98332c36d19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14552145aeb14d838370c33104ae8374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:18:08 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Creating image(s)
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.226s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.208s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6190912-f94d-4874-bed7-697e8bd63427 req-91f462ca-e638-452a-aff5-1755aa9e039f service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6190912-f94d-4874-bed7-697e8bd63427 req-91f462ca-e638-452a-aff5-1755aa9e039f service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6190912-f94d-4874-bed7-697e8bd63427 req-91f462ca-e638-452a-aff5-1755aa9e039f service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6190912-f94d-4874-bed7-697e8bd63427 req-91f462ca-e638-452a-aff5-1755aa9e039f service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6190912-f94d-4874-bed7-697e8bd63427 req-91f462ca-e638-452a-aff5-1755aa9e039f service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:08 user nova-compute[73158]: WARNING nova.compute.manager [req-f6190912-f94d-4874-bed7-697e8bd63427 req-91f462ca-e638-452a-aff5-1755aa9e039f service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk 1073741824" returned: 0 in 0.053s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:18:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Cannot resize image /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'migration_context' on Instance uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Ensure instance console log exists: /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Successfully created port: 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:18:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for ca69a434-ae39-4400-a07f-b49c41f99e84 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267490.5285058, ca69a434-ae39-4400-a07f-b49c41f99e84 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Resumed (Lifecycle Event)
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0e275a40-3248-4933-a2e8-b4c1188fabcb tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:18:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267490.5313725, ca69a434-ae39-4400-a07f-b49c41f99e84 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Started (Lifecycle Event)
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:10 user nova-compute[73158]: WARNING nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state None.
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:10 user nova-compute[73158]: WARNING nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state None.
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:10 user nova-compute[73158]: WARNING nova.compute.manager [req-54cdcfce-1b9a-427c-b1c7-a63b1a9c1b54 req-365b9ad5-f933-45a2-a881-a14faf493dea service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state active and task_state None.
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.network.neutron [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Successfully updated port: 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquired lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:10 user nova-compute[73158]: DEBUG nova.network.neutron [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.network.neutron [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:11 user nova-compute[73158]: INFO nova.compute.manager [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] instance snapshotting
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.network.neutron [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updating instance_info_cache with network_info: [{"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Beginning live snapshot process
Aug 17 10:18:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Releasing lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Instance network_info: |[{"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Start _get_guest_xml network_info=[{"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:18:11 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:18:11 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451338262',display_name='tempest-AttachVolumeNegativeTest-server-451338262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451338262',id=20,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdY4wgra98gyHuGpUEJWdUqnayXeHto8P1zE7Rq3CiMHI9Yt+N2hAFk2shNP8FqUVJttqNHPVPA6kmZrTjVfKCIrg19ilb8AnkW5YKhmd9i4MfQyEV/cIJXx7dCRZ+FJg==',key_name='tempest-keypair-1209704172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-snsmakn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=ad8969a2-c443-4bba-b7d2-2b85a77e7bbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'pci_devices' on Instance uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:18:11 user nova-compute[73158]:   <uuid>ad8969a2-c443-4bba-b7d2-2b85a77e7bbc</uuid>
Aug 17 10:18:11 user nova-compute[73158]:   <name>instance-00000014</name>
Aug 17 10:18:11 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:18:11 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:18:11 user nova-compute[73158]:   <metadata>
Aug 17 10:18:11 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:18:11 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:18:11 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeNegativeTest-server-451338262</nova:name>
Aug 17 10:18:11 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:18:11</nova:creationTime>
Aug 17 10:18:11 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:18:11 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:18:11 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:18:11 user nova-compute[73158]:       <nova:owner>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:user uuid="1978c81194804f6cbd5e98332c36d19d">tempest-AttachVolumeNegativeTest-1781394635-project-member</nova:user>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:project uuid="14552145aeb14d838370c33104ae8374">tempest-AttachVolumeNegativeTest-1781394635</nova:project>
Aug 17 10:18:11 user nova-compute[73158]:       </nova:owner>
Aug 17 10:18:11 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:18:11 user nova-compute[73158]:       <nova:ports>
Aug 17 10:18:11 user nova-compute[73158]:         <nova:port uuid="548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6">
Aug 17 10:18:11 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 10:18:11 user nova-compute[73158]:         </nova:port>
Aug 17 10:18:11 user nova-compute[73158]:       </nova:ports>
Aug 17 10:18:11 user nova-compute[73158]:     </nova:instance>
Aug 17 10:18:11 user nova-compute[73158]:   </metadata>
Aug 17 10:18:11 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:18:11 user nova-compute[73158]:     <system>
Aug 17 10:18:11 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:18:11 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:18:11 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:18:11 user nova-compute[73158]:       <entry name="serial">ad8969a2-c443-4bba-b7d2-2b85a77e7bbc</entry>
Aug 17 10:18:11 user nova-compute[73158]:       <entry name="uuid">ad8969a2-c443-4bba-b7d2-2b85a77e7bbc</entry>
Aug 17 10:18:11 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:18:11 user nova-compute[73158]:     </system>
Aug 17 10:18:11 user nova-compute[73158]:   </sysinfo>
Aug 17 10:18:11 user nova-compute[73158]:   <os>
Aug 17 10:18:11 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:18:11 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:18:11 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:18:11 user nova-compute[73158]:   </os>
Aug 17 10:18:11 user nova-compute[73158]:   <features>
Aug 17 10:18:11 user nova-compute[73158]:     <acpi/>
Aug 17 10:18:11 user nova-compute[73158]:     <apic/>
Aug 17 10:18:11 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:18:11 user nova-compute[73158]:   </features>
Aug 17 10:18:11 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:18:11 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:18:11 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:18:11 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:18:11 user nova-compute[73158]:   </clock>
Aug 17 10:18:11 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:18:11 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:18:11 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:18:11 user nova-compute[73158]:   </cpu>
Aug 17 10:18:11 user nova-compute[73158]:   <devices>
Aug 17 10:18:11 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:18:11 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:18:11 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk"/>
Aug 17 10:18:11 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:18:11 user nova-compute[73158]:     </disk>
Aug 17 10:18:11 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:18:11 user nova-compute[73158]:       <mac address="fa:16:3e:85:df:1c"/>
Aug 17 10:18:11 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:18:11 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:18:11 user nova-compute[73158]:       <target dev="tap548c5ca8-8c"/>
Aug 17 10:18:11 user nova-compute[73158]:     </interface>
Aug 17 10:18:11 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:18:11 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/console.log" append="off"/>
Aug 17 10:18:11 user nova-compute[73158]:     </serial>
Aug 17 10:18:11 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:18:11 user nova-compute[73158]:     <video>
Aug 17 10:18:11 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:18:11 user nova-compute[73158]:     </video>
Aug 17 10:18:11 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:18:11 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:18:11 user nova-compute[73158]:     </rng>
Aug 17 10:18:11 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:18:11 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:18:11 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:18:11 user nova-compute[73158]:     </memballoon>
Aug 17 10:18:11 user nova-compute[73158]:   </devices>
Aug 17 10:18:11 user nova-compute[73158]: </domain>
Aug 17 10:18:11 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451338262',display_name='tempest-AttachVolumeNegativeTest-server-451338262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451338262',id=20,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdY4wgra98gyHuGpUEJWdUqnayXeHto8P1zE7Rq3CiMHI9Yt+N2hAFk2shNP8FqUVJttqNHPVPA6kmZrTjVfKCIrg19ilb8AnkW5YKhmd9i4MfQyEV/cIJXx7dCRZ+FJg==',key_name='tempest-keypair-1209704172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-snsmakn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=ad8969a2-c443-4bba-b7d2-2b85a77e7bbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG os_vif [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap548c5ca8-8c, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap548c5ca8-8c, col_values=(('external_ids', {'iface-id': '548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:df:1c', 'vm-uuid': 'ad8969a2-c443-4bba-b7d2-2b85a77e7bbc'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:11 user nova-compute[73158]: INFO os_vif [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c')
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:85:df:1c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.214s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkpxgm436/81f373d4068f416a876c0db94baa7e76.delta 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkpxgm436/81f373d4068f416a876c0db94baa7e76.delta 1073741824" returned: 0 in 0.051s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 10:18:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-changed-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Refreshing instance network info cache due to event network-changed-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] Acquiring lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] Acquired lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:12 user nova-compute[73158]: DEBUG nova.network.neutron [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Refreshing network info cache for port 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updated VIF entry in instance network info cache for port 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updating instance_info_cache with network_info: [{"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c95cc1ab-46b5-4bd7-8b29-421eb9c38b4f req-2619b92d-1380-4354-8b90-6652e31f6657 service nova] Releasing lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] COPY block job progress, current cursor: 19988480 final cursor: 75497472 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-02a99ce7-33d4-40b3-947a-6a57d7dd22af req-3bfc1815-2eb1-4ad2-84de-5a8207f9c31a service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-02a99ce7-33d4-40b3-947a-6a57d7dd22af req-3bfc1815-2eb1-4ad2-84de-5a8207f9c31a service nova] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-02a99ce7-33d4-40b3-947a-6a57d7dd22af req-3bfc1815-2eb1-4ad2-84de-5a8207f9c31a service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-02a99ce7-33d4-40b3-947a-6a57d7dd22af req-3bfc1815-2eb1-4ad2-84de-5a8207f9c31a service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-02a99ce7-33d4-40b3-947a-6a57d7dd22af req-3bfc1815-2eb1-4ad2-84de-5a8207f9c31a service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] No waiting events found dispatching network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:14 user nova-compute[73158]: WARNING nova.compute.manager [req-02a99ce7-33d4-40b3-947a-6a57d7dd22af req-3bfc1815-2eb1-4ad2-84de-5a8207f9c31a service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received unexpected event network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 for instance with vm_state building and task_state spawning.
Aug 17 10:18:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:18:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 10:18:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkpxgm436/81f373d4068f416a876c0db94baa7e76.delta /opt/stack/data/nova/instances/snapshots/tmpkpxgm436/81f373d4068f416a876c0db94baa7e76 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkpxgm436/81f373d4068f416a876c0db94baa7e76.delta /opt/stack/data/nova/instances/snapshots/tmpkpxgm436/81f373d4068f416a876c0db94baa7e76" returned: 0 in 0.713s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:15 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Snapshot extracted, beginning image upload
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-2e6ced51-a1fe-4c92-9dfa-e91ad3b38c7b req-7a712773-5d72-4062-aa8b-cf80537b7689 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2e6ced51-a1fe-4c92-9dfa-e91ad3b38c7b req-7a712773-5d72-4062-aa8b-cf80537b7689 service nova] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2e6ced51-a1fe-4c92-9dfa-e91ad3b38c7b req-7a712773-5d72-4062-aa8b-cf80537b7689 service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2e6ced51-a1fe-4c92-9dfa-e91ad3b38c7b req-7a712773-5d72-4062-aa8b-cf80537b7689 service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-2e6ced51-a1fe-4c92-9dfa-e91ad3b38c7b req-7a712773-5d72-4062-aa8b-cf80537b7689 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] No waiting events found dispatching network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:16 user nova-compute[73158]: WARNING nova.compute.manager [req-2e6ced51-a1fe-4c92-9dfa-e91ad3b38c7b req-7a712773-5d72-4062-aa8b-cf80537b7689 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received unexpected event network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 for instance with vm_state building and task_state spawning.
Aug 17 10:18:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267496.3617744, ad8969a2-c443-4bba-b7d2-2b85a77e7bbc => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] VM Resumed (Lifecycle Event)
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Instance spawned successfully.
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267496.3631306, ad8969a2-c443-4bba-b7d2-2b85a77e7bbc => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] VM Started (Lifecycle Event)
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Took 8.39 seconds to spawn the instance on the hypervisor.
Aug 17 10:18:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:16 user nova-compute[73158]: INFO nova.compute.manager [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Took 9.50 seconds to build instance.
Aug 17 10:18:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-53b7b2ba-2fc8-4802-aa5e-bf77303953db tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.677s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Snapshot image upload complete
Aug 17 10:18:18 user nova-compute[73158]: INFO nova.compute.manager [None req-363dfba3-e692-4f54-b61f-98fc5cf8940d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Took 6.87 seconds to snapshot the instance on the hypervisor.
Aug 17 10:18:19 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267484.6647303, c3b24204-badc-4d40-9b96-5a8b07a49250 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:19 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] VM Stopped (Lifecycle Event)
Aug 17 10:18:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-01584649-f0ec-4e36-8163-3ec8909b8a93 None None] [instance: c3b24204-badc-4d40-9b96-5a8b07a49250] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:18:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid f59460b3-cc6b-49db-b4d7-a86e2006de30 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 300a9c6a-ed23-494d-8f26-9b5b333273f4 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "a43f242b-fdf6-4153-acad-344d28610631" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "a43f242b-fdf6-4153-acad-344d28610631" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:18:28 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:18:28 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7206MB free_disk=24.508270263671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a43f242b-fdf6-4153-acad-344d28610631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:18:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:18:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:18:37 user nova-compute[73158]: INFO nova.compute.claims [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Claim successful on node user
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:18:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.policy [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbecf64518ba437895e7816c5ad54b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07223795d5094ee1b75158a794497264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:18:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Creating image(s)
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "/opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "/opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.173s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk 1073741824" returned: 0 in 0.077s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Successfully created port: 55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lazy-loading 'migration_context' on Instance uuid 2bf5b399-8fd5-42e4-8155-09bdf972628d {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Successfully updated port: 55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "refresh_cache-2bf5b399-8fd5-42e4-8155-09bdf972628d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquired lock "refresh_cache-2bf5b399-8fd5-42e4-8155-09bdf972628d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-changed-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Refreshing instance network info cache due to event network-changed-55618661-f6be-4231-b549-1fd23e216e7a. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] Acquiring lock "refresh_cache-2bf5b399-8fd5-42e4-8155-09bdf972628d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Updating instance_info_cache with network_info: [{"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Releasing lock "refresh_cache-2bf5b399-8fd5-42e4-8155-09bdf972628d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Instance network_info: |[{"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] Acquired lock "refresh_cache-2bf5b399-8fd5-42e4-8155-09bdf972628d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Refreshing network info cache for port 55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Start _get_guest_xml network_info=[{"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:18:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:18:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-922737175',display_name='tempest-VolumesActionsTest-instance-922737175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-922737175',id=21,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07223795d5094ee1b75158a794497264',ramdisk_id='',reservation_id='r-9pvscdrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1130727858',owner_user_name='tempest-VolumesActionsTest-1130727858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:18:38Z,user_data=None,user_id='cbecf64518ba437895e7816c5ad54b9d',uuid=2bf5b399-8fd5-42e4-8155-09bdf972628d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converting VIF {"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf5b399-8fd5-42e4-8155-09bdf972628d {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:18:39 user nova-compute[73158]:   <uuid>2bf5b399-8fd5-42e4-8155-09bdf972628d</uuid>
Aug 17 10:18:39 user nova-compute[73158]:   <name>instance-00000015</name>
Aug 17 10:18:39 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:18:39 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:18:39 user nova-compute[73158]:   <metadata>
Aug 17 10:18:39 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:18:39 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:18:39 user nova-compute[73158]:       <nova:name>tempest-VolumesActionsTest-instance-922737175</nova:name>
Aug 17 10:18:39 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:18:39</nova:creationTime>
Aug 17 10:18:39 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:18:39 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:18:39 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:18:39 user nova-compute[73158]:       <nova:owner>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:user uuid="cbecf64518ba437895e7816c5ad54b9d">tempest-VolumesActionsTest-1130727858-project-member</nova:user>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:project uuid="07223795d5094ee1b75158a794497264">tempest-VolumesActionsTest-1130727858</nova:project>
Aug 17 10:18:39 user nova-compute[73158]:       </nova:owner>
Aug 17 10:18:39 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:18:39 user nova-compute[73158]:       <nova:ports>
Aug 17 10:18:39 user nova-compute[73158]:         <nova:port uuid="55618661-f6be-4231-b549-1fd23e216e7a">
Aug 17 10:18:39 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 10:18:39 user nova-compute[73158]:         </nova:port>
Aug 17 10:18:39 user nova-compute[73158]:       </nova:ports>
Aug 17 10:18:39 user nova-compute[73158]:     </nova:instance>
Aug 17 10:18:39 user nova-compute[73158]:   </metadata>
Aug 17 10:18:39 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:18:39 user nova-compute[73158]:     <system>
Aug 17 10:18:39 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:18:39 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:18:39 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:18:39 user nova-compute[73158]:       <entry name="serial">2bf5b399-8fd5-42e4-8155-09bdf972628d</entry>
Aug 17 10:18:39 user nova-compute[73158]:       <entry name="uuid">2bf5b399-8fd5-42e4-8155-09bdf972628d</entry>
Aug 17 10:18:39 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:18:39 user nova-compute[73158]:     </system>
Aug 17 10:18:39 user nova-compute[73158]:   </sysinfo>
Aug 17 10:18:39 user nova-compute[73158]:   <os>
Aug 17 10:18:39 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:18:39 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:18:39 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:18:39 user nova-compute[73158]:   </os>
Aug 17 10:18:39 user nova-compute[73158]:   <features>
Aug 17 10:18:39 user nova-compute[73158]:     <acpi/>
Aug 17 10:18:39 user nova-compute[73158]:     <apic/>
Aug 17 10:18:39 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:18:39 user nova-compute[73158]:   </features>
Aug 17 10:18:39 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:18:39 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:18:39 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:18:39 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:18:39 user nova-compute[73158]:   </clock>
Aug 17 10:18:39 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:18:39 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:18:39 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:18:39 user nova-compute[73158]:   </cpu>
Aug 17 10:18:39 user nova-compute[73158]:   <devices>
Aug 17 10:18:39 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:18:39 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:18:39 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk"/>
Aug 17 10:18:39 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:18:39 user nova-compute[73158]:     </disk>
Aug 17 10:18:39 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:18:39 user nova-compute[73158]:       <mac address="fa:16:3e:48:56:13"/>
Aug 17 10:18:39 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:18:39 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:18:39 user nova-compute[73158]:       <target dev="tap55618661-f6"/>
Aug 17 10:18:39 user nova-compute[73158]:     </interface>
Aug 17 10:18:39 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:18:39 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/console.log" append="off"/>
Aug 17 10:18:39 user nova-compute[73158]:     </serial>
Aug 17 10:18:39 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:18:39 user nova-compute[73158]:     <video>
Aug 17 10:18:39 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:18:39 user nova-compute[73158]:     </video>
Aug 17 10:18:39 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:18:39 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:18:39 user nova-compute[73158]:     </rng>
Aug 17 10:18:39 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:18:39 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:18:39 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:18:39 user nova-compute[73158]:     </memballoon>
Aug 17 10:18:39 user nova-compute[73158]:   </devices>
Aug 17 10:18:39 user nova-compute[73158]: </domain>
Aug 17 10:18:39 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-922737175',display_name='tempest-VolumesActionsTest-instance-922737175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-922737175',id=21,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07223795d5094ee1b75158a794497264',ramdisk_id='',reservation_id='r-9pvscdrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1130727858',owner_user_name='tempest-VolumesActionsTest-1130727858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:18:38Z,user_data=None,user_id='cbecf64518ba437895e7816c5ad54b9d',uuid=2bf5b399-8fd5-42e4-8155-09bdf972628d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converting VIF {"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG os_vif [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55618661-f6, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55618661-f6, col_values=(('external_ids', {'iface-id': '55618661-f6be-4231-b549-1fd23e216e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:56:13', 'vm-uuid': '2bf5b399-8fd5-42e4-8155-09bdf972628d'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:18:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:40 user nova-compute[73158]: INFO os_vif [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6')
Aug 17 10:18:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:18:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] No VIF found with MAC fa:16:3e:48:56:13, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:18:40 user nova-compute[73158]: DEBUG nova.network.neutron [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Updated VIF entry in instance network info cache for port 55618661-f6be-4231-b549-1fd23e216e7a. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:18:40 user nova-compute[73158]: DEBUG nova.network.neutron [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Updating instance_info_cache with network_info: [{"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-320c7320-b22d-4ae4-a4d6-fc8068f6f472 req-d551958a-0c5e-4bf9-b982-30b28e66747f service nova] Releasing lock "refresh_cache-2bf5b399-8fd5-42e4-8155-09bdf972628d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-a365832a-44ff-4b80-bfc9-e169705cc339 req-cc1e0357-858a-422f-85bc-b2af01027513 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a365832a-44ff-4b80-bfc9-e169705cc339 req-cc1e0357-858a-422f-85bc-b2af01027513 service nova] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a365832a-44ff-4b80-bfc9-e169705cc339 req-cc1e0357-858a-422f-85bc-b2af01027513 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a365832a-44ff-4b80-bfc9-e169705cc339 req-cc1e0357-858a-422f-85bc-b2af01027513 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-a365832a-44ff-4b80-bfc9-e169705cc339 req-cc1e0357-858a-422f-85bc-b2af01027513 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] No waiting events found dispatching network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:42 user nova-compute[73158]: WARNING nova.compute.manager [req-a365832a-44ff-4b80-bfc9-e169705cc339 req-cc1e0357-858a-422f-85bc-b2af01027513 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received unexpected event network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a for instance with vm_state building and task_state spawning.
Aug 17 10:18:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "interface-a43f242b-fdf6-4153-acad-344d28610631-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "interface-a43f242b-fdf6-4153-acad-344d28610631-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'flavor' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'pci_requests' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.policy [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d012173c11e42e090143411f4d9f34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb17cb60c0714fabb50a01bafaf56a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Successfully created port: 1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267523.729701, 2bf5b399-8fd5-42e4-8155-09bdf972628d => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] VM Resumed (Lifecycle Event)
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Instance spawned successfully.
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267523.7329514, 2bf5b399-8fd5-42e4-8155-09bdf972628d => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] VM Started (Lifecycle Event)
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 17 10:18:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:18:43 user nova-compute[73158]: INFO nova.compute.manager [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Took 6.97 seconds to build instance.
Aug 17 10:18:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76a449dd-5dbe-4001-bcf4-b8cde58a8170 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.067s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-changed-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Refreshing instance network info cache due to event network-changed-6a4f2143-f2bd-4467-a926-244b2dc8aedd. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] Acquiring lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] Acquired lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.network.neutron [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Refreshing network info cache for port 6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Successfully updated port: 1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-changed-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Refreshing instance network info cache due to event network-changed-1ac7ed64-418b-4388-81ab-799ccbf414e0. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] Acquiring lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.network.neutron [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updated VIF entry in instance network info cache for port 6a4f2143-f2bd-4467-a926-244b2dc8aedd. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.network.neutron [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] Releasing lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] No waiting events found dispatching network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:44 user nova-compute[73158]: WARNING nova.compute.manager [req-1a3a4220-a9ad-49dd-bb94-c8eb065b0900 req-c0dc52ff-021f-45a7-ab1d-ccfd9d818956 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received unexpected event network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a for instance with vm_state active and task_state None.
Aug 17 10:18:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquired lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:18:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.network.neutron [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Releasing lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] Acquired lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.network.neutron [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Refreshing network info cache for port 1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG os_vif [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ac7ed64-41, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ac7ed64-41, col_values=(('external_ids', {'iface-id': '1ac7ed64-418b-4388-81ab-799ccbf414e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:fb:22', 'vm-uuid': 'a43f242b-fdf6-4153-acad-344d28610631'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: INFO os_vif [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41')
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] attach device xml: <interface type="ethernet">
Aug 17 10:18:45 user nova-compute[73158]:   <mac address="fa:16:3e:52:fb:22"/>
Aug 17 10:18:45 user nova-compute[73158]:   <model type="virtio"/>
Aug 17 10:18:45 user nova-compute[73158]:   <mtu size="1442"/>
Aug 17 10:18:45 user nova-compute[73158]:   <target dev="tap1ac7ed64-41"/>
Aug 17 10:18:45 user nova-compute[73158]: </interface>
Aug 17 10:18:45 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No BDM found with device name hda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No VIF found with MAC fa:16:3e:ba:87:a1, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:18:46 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:18:46 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:18:46 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:18:46</nova:creationTime>
Aug 17 10:18:46 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:18:46 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:18:46 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:18:46 user nova-compute[73158]:   <nova:owner>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:18:46 user nova-compute[73158]:   </nova:owner>
Aug 17 10:18:46 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:18:46 user nova-compute[73158]:   <nova:ports>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:18:46 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:18:46 user nova-compute[73158]:     </nova:port>
Aug 17 10:18:46 user nova-compute[73158]:     <nova:port uuid="1ac7ed64-418b-4388-81ab-799ccbf414e0">
Aug 17 10:18:46 user nova-compute[73158]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Aug 17 10:18:46 user nova-compute[73158]:     </nova:port>
Aug 17 10:18:46 user nova-compute[73158]:   </nova:ports>
Aug 17 10:18:46 user nova-compute[73158]: </nova:instance>
Aug 17 10:18:46 user nova-compute[73158]:  {{(pid=73158) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7d2b1e40-ec9d-401d-8bd0-dfe49006b4e0 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "interface-a43f242b-fdf6-4153-acad-344d28610631-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.606s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-e210652f-4a99-46e3-8c6f-edd7954fa060 req-c54d115c-4d7f-49af-9abb-2cd82a98870b service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e210652f-4a99-46e3-8c6f-edd7954fa060 req-c54d115c-4d7f-49af-9abb-2cd82a98870b service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e210652f-4a99-46e3-8c6f-edd7954fa060 req-c54d115c-4d7f-49af-9abb-2cd82a98870b service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e210652f-4a99-46e3-8c6f-edd7954fa060 req-c54d115c-4d7f-49af-9abb-2cd82a98870b service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-e210652f-4a99-46e3-8c6f-edd7954fa060 req-c54d115c-4d7f-49af-9abb-2cd82a98870b service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:46 user nova-compute[73158]: WARNING nova.compute.manager [req-e210652f-4a99-46e3-8c6f-edd7954fa060 req-c54d115c-4d7f-49af-9abb-2cd82a98870b service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 for instance with vm_state active and task_state None.
Aug 17 10:18:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.network.neutron [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updated VIF entry in instance network info cache for port 1ac7ed64-418b-4388-81ab-799ccbf414e0. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.network.neutron [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-30a03719-6af2-4135-94d5-d93092349da1 req-e30dd856-a2d0-4d79-bdf2-15bb24dce402 service nova] Releasing lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'flavor' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:47 user nova-compute[73158]: INFO nova.compute.manager [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Attaching volume 370e16e4-752f-49cd-a174-97562faa1a2c to /dev/vdb
Aug 17 10:18:47 user nova-compute[73158]: DEBUG os_brick.utils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ccb54b-7dae-4d97-a3e6-495dae3d5b86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc416018-2e8d-45b7-96b2-3d1a48ec1ee6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a5184-af19-404d-9605-50efd8d008aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1b7ece-d607-4978-889e-bce2e5bcd274]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:18:47 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:18:47 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[74586410-0576-4f68-9b11-5e953ea33dee]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG os_brick.utils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:18:47 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating existing volume attachment record: 69c19164-28cc-46dd-9ade-403908f123ce {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:18:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0d36000-34d8-480b-a9ad-ff875c23d3be req-4c57e8b2-94b9-429d-a6be-3d9e488665f7 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:18:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0d36000-34d8-480b-a9ad-ff875c23d3be req-4c57e8b2-94b9-429d-a6be-3d9e488665f7 service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:18:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0d36000-34d8-480b-a9ad-ff875c23d3be req-4c57e8b2-94b9-429d-a6be-3d9e488665f7 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:18:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0d36000-34d8-480b-a9ad-ff875c23d3be req-4c57e8b2-94b9-429d-a6be-3d9e488665f7 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:18:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0d36000-34d8-480b-a9ad-ff875c23d3be req-4c57e8b2-94b9-429d-a6be-3d9e488665f7 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:18:48 user nova-compute[73158]: WARNING nova.compute.manager [req-f0d36000-34d8-480b-a9ad-ff875c23d3be req-4c57e8b2-94b9-429d-a6be-3d9e488665f7 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 for instance with vm_state active and task_state None.
Aug 17 10:18:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYlicCRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:18:58 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:18:58 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:18:58 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[632542dd-61de-4318-9369-f915103bb823]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:18:58 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b4284b-0365-4310-84e8-773894ead504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c] added
Aug 17 10:18:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4d05b-fc53-48f6-b936-9752d9c21e08]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4940079-4e1e-4e10-8264-3b671cb37ec0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYlicCRy {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYlicCRy" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f8902-80ba-4b5c-9491-91183e2d5fdd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYlicCRy'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408fa93-74bf-4a06-9edd-bb82f3bf255d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7a45d0-e4e1-4324-b739-08b0dd442647]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:18:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:18:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd5d30-06bb-4d09-96dc-591d7698bf31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260]
Aug 17 10:18:58 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260] successful.
Aug 17 10:18:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716322e-aa24-4794-a590-483a5b11727e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046fe65-6190-4b7a-96d0-a476bf608416]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:18:58 user nova-compute[73158]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c (non-flash)
Aug 17 10:18:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:18:58 user nova-compute[73158]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c (non-flash)
Aug 17 10:18:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6297086-d052-42ce-b6fb-b6807730bc8d]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYlicCRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:18:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:18:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:18:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26639343733306631', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:18:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639343733306631', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:18:59 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'flavor' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:18:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:18:59 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:18:59 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:18:59 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:18:59 user nova-compute[73158]:   <serial>370e16e4-752f-49cd-a174-97562faa1a2c</serial>
Aug 17 10:18:59 user nova-compute[73158]: </disk>
Aug 17 10:18:59 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:19:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:19:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No BDM found with device name hda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:19:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] No VIF found with MAC fa:16:3e:ba:87:a1, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:19:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a300c110-473c-4355-9e77-614c86e08446 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.530s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:01 user nova-compute[73158]: INFO nova.compute.manager [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Detaching volume 370e16e4-752f-49cd-a174-97562faa1a2c
Aug 17 10:19:02 user nova-compute[73158]: INFO nova.virt.block_device [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Attempting to driver detach volume 370e16e4-752f-49cd-a174-97562faa1a2c from mountpoint /dev/vdb
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Attempting to detach device vdb from instance a43f242b-fdf6-4153-acad-344d28610631 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:19:02 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:19:02 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:19:02 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:19:02 user nova-compute[73158]:   <serial>370e16e4-752f-49cd-a174-97562faa1a2c</serial>
Aug 17 10:19:02 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 10:19:02 user nova-compute[73158]: </disk>
Aug 17 10:19:02 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:19:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully detached device vdb from instance a43f242b-fdf6-4153-acad-344d28610631 from the persistent domain config.
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a43f242b-fdf6-4153-acad-344d28610631 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:19:02 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:19:02 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:19:02 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:19:02 user nova-compute[73158]:   <serial>370e16e4-752f-49cd-a174-97562faa1a2c</serial>
Aug 17 10:19:02 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 10:19:02 user nova-compute[73158]: </disk>
Aug 17 10:19:02 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:19:02 user nova-compute[73158]: INFO nova.compute.claims [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Claim successful on node user
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267542.484583, a43f242b-fdf6-4153-acad-344d28610631 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:19:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully detached device vdb from instance a43f242b-fdf6-4153-acad-344d28610631 from the live domain config.
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYlicCRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:19:02 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfde1b04-83df-4951-84d1-007d17bfcef9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337409a-5c35-4802-aed0-93009a83916c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:19:02 user nova-compute[73158]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c (non-flash)
Aug 17 10:19:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:19:02 user nova-compute[73158]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c (non-flash)
Aug 17 10:19:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c16c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1404af0b-c9a3-4254-8bd7-1ba515811f29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2369bd-c365-4557-9150-c42212a1373b]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1906610-9bde-4998-a818-ac86d2e697ce]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2604db-ab92-433c-b8d8-de9d9bb56783]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b472156-1e27-48c7-9859-c5f88d10416d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef10e9d-babb-4e69-a448-114970f5d2b6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260]
Aug 17 10:19:02 user nova-compute[73158]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c, portal: 172.16.0.220,3260] successful.
Aug 17 10:19:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370e16e4-752f-49cd-a174-97562faa1a2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d202fbf-77e9-4217-8106-aad227d2e973]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] <== disconnect_volume: return (282ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:19:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:19:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.policy [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '908f0da6a47c4ba295fee97cf4e88234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d6d6113124771be6093c99e106c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:19:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Creating image(s)
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "/opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "/opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'flavor' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-40e398a6-73f1-4c7c-979a-95dfdb0fbdba tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk 1073741824" returned: 0 in 0.054s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Cannot resize image /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'migration_context' on Instance uuid d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "interface-a43f242b-fdf6-4153-acad-344d28610631-1ac7ed64-418b-4388-81ab-799ccbf414e0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "interface-a43f242b-fdf6-4153-acad-344d28610631-1ac7ed64-418b-4388-81ab-799ccbf414e0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Ensure instance console log exists: /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'flavor' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface> {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface> {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Attempting to detach device tap1ac7ed64-41 from instance a43f242b-fdf6-4153-acad-344d28610631 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] detach device xml: <interface type="ethernet">
Aug 17 10:19:04 user nova-compute[73158]:   <mac address="fa:16:3e:52:fb:22"/>
Aug 17 10:19:04 user nova-compute[73158]:   <model type="virtio"/>
Aug 17 10:19:04 user nova-compute[73158]:   <mtu size="1442"/>
Aug 17 10:19:04 user nova-compute[73158]:   <target dev="tap1ac7ed64-41"/>
Aug 17 10:19:04 user nova-compute[73158]: </interface>
Aug 17 10:19:04 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface> {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 10:19:04 user nova-compute[73158]:   <name>instance-00000011</name>
Aug 17 10:19:04 user nova-compute[73158]:   <uuid>a43f242b-fdf6-4153-acad-344d28610631</uuid>
Aug 17 10:19:04 user nova-compute[73158]:   <metadata>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:04 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:18:46</nova:creationTime>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:19:04 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:owner>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:owner>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:ports>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:19:04 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:19:04 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:port uuid="1ac7ed64-418b-4388-81ab-799ccbf414e0">
Aug 17 10:19:04 user nova-compute[73158]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Aug 17 10:19:04 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:ports>
Aug 17 10:19:04 user nova-compute[73158]: </nova:instance>
Aug 17 10:19:04 user nova-compute[73158]:   </metadata>
Aug 17 10:19:04 user nova-compute[73158]:   <memory unit='KiB'>524288</memory>
Aug 17 10:19:04 user nova-compute[73158]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 10:19:04 user nova-compute[73158]:   <vcpu placement='static'>1</vcpu>
Aug 17 10:19:04 user nova-compute[73158]:   <resource>
Aug 17 10:19:04 user nova-compute[73158]:     <partition>/machine</partition>
Aug 17 10:19:04 user nova-compute[73158]:   </resource>
Aug 17 10:19:04 user nova-compute[73158]:   <sysinfo type='smbios'>
Aug 17 10:19:04 user nova-compute[73158]:     <system>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='version'>0.0.0</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='serial'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='uuid'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='family'>Virtual Machine</entry>
Aug 17 10:19:04 user nova-compute[73158]:     </system>
Aug 17 10:19:04 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:04 user nova-compute[73158]:   <os>
Aug 17 10:19:04 user nova-compute[73158]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 10:19:04 user nova-compute[73158]:     <boot dev='hd'/>
Aug 17 10:19:04 user nova-compute[73158]:     <smbios mode='sysinfo'/>
Aug 17 10:19:04 user nova-compute[73158]:   </os>
Aug 17 10:19:04 user nova-compute[73158]:   <features>
Aug 17 10:19:04 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:04 user nova-compute[73158]:     <apic/>
Aug 17 10:19:04 user nova-compute[73158]:     <vmcoreinfo state='on'/>
Aug 17 10:19:04 user nova-compute[73158]:   </features>
Aug 17 10:19:04 user nova-compute[73158]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 10:19:04 user nova-compute[73158]:     <model fallback='forbid'>Nehalem</model>
Aug 17 10:19:04 user nova-compute[73158]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 10:19:04 user nova-compute[73158]:     <feature policy='require' name='vme'/>
Aug 17 10:19:04 user nova-compute[73158]:     <feature policy='require' name='x2apic'/>
Aug 17 10:19:04 user nova-compute[73158]:     <feature policy='require' name='hypervisor'/>
Aug 17 10:19:04 user nova-compute[73158]:   </cpu>
Aug 17 10:19:04 user nova-compute[73158]:   <clock offset='utc'>
Aug 17 10:19:04 user nova-compute[73158]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 10:19:04 user nova-compute[73158]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 10:19:04 user nova-compute[73158]:     <timer name='hpet' present='no'/>
Aug 17 10:19:04 user nova-compute[73158]:   </clock>
Aug 17 10:19:04 user nova-compute[73158]:   <on_poweroff>destroy</on_poweroff>
Aug 17 10:19:04 user nova-compute[73158]:   <on_reboot>restart</on_reboot>
Aug 17 10:19:04 user nova-compute[73158]:   <on_crash>destroy</on_crash>
Aug 17 10:19:04 user nova-compute[73158]:   <devices>
Aug 17 10:19:04 user nova-compute[73158]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 10:19:04 user nova-compute[73158]:     <disk type='file' device='disk'>
Aug 17 10:19:04 user nova-compute[73158]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 10:19:04 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk' index='2'/>
Aug 17 10:19:04 user nova-compute[73158]:       <backingStore type='file' index='3'>
Aug 17 10:19:04 user nova-compute[73158]:         <format type='raw'/>
Aug 17 10:19:04 user nova-compute[73158]:         <source file='/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc'/>
Aug 17 10:19:04 user nova-compute[73158]:         <backingStore/>
Aug 17 10:19:04 user nova-compute[73158]:       </backingStore>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='vda' bus='virtio'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='virtio-disk0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </disk>
Aug 17 10:19:04 user nova-compute[73158]:     <disk type='file' device='cdrom'>
Aug 17 10:19:04 user nova-compute[73158]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 10:19:04 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config' index='1'/>
Aug 17 10:19:04 user nova-compute[73158]:       <backingStore/>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='hda' bus='ide'/>
Aug 17 10:19:04 user nova-compute[73158]:       <readonly/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='ide0-0-0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </disk>
Aug 17 10:19:04 user nova-compute[73158]:     <controller type='usb' index='0' model='none'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='usb'/>
Aug 17 10:19:04 user nova-compute[73158]:     </controller>
Aug 17 10:19:04 user nova-compute[73158]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='pci.0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </controller>
Aug 17 10:19:04 user nova-compute[73158]:     <controller type='ide' index='0'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='ide'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 10:19:04 user nova-compute[73158]:     </controller>
Aug 17 10:19:04 user nova-compute[73158]:     <interface type='ethernet'>
Aug 17 10:19:04 user nova-compute[73158]:       <mac address='fa:16:3e:ba:87:a1'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='tap6a4f2143-f2'/>
Aug 17 10:19:04 user nova-compute[73158]:       <model type='virtio'/>
Aug 17 10:19:04 user nova-compute[73158]:       <mtu size='1442'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='net0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </interface>
Aug 17 10:19:04 user nova-compute[73158]:     <interface type='ethernet'>
Aug 17 10:19:04 user nova-compute[73158]:       <mac address='fa:16:3e:52:fb:22'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='tap1ac7ed64-41'/>
Aug 17 10:19:04 user nova-compute[73158]:       <model type='virtio'/>
Aug 17 10:19:04 user nova-compute[73158]:       <mtu size='1442'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='net1'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </interface>
Aug 17 10:19:04 user nova-compute[73158]:     <serial type='pty'>
Aug 17 10:19:04 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:04 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target type='isa-serial' port='0'>
Aug 17 10:19:04 user nova-compute[73158]:         <model name='isa-serial'/>
Aug 17 10:19:04 user nova-compute[73158]:       </target>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </serial>
Aug 17 10:19:04 user nova-compute[73158]:     <console type='pty' tty='/dev/pts/10'>
Aug 17 10:19:04 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:04 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target type='serial' port='0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </console>
Aug 17 10:19:04 user nova-compute[73158]:     <input type='mouse' bus='ps2'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='input0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </input>
Aug 17 10:19:04 user nova-compute[73158]:     <input type='keyboard' bus='ps2'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='input1'/>
Aug 17 10:19:04 user nova-compute[73158]:     </input>
Aug 17 10:19:04 user nova-compute[73158]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 17 10:19:04 user nova-compute[73158]:       <listen type='address' address='0.0.0.0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </graphics>
Aug 17 10:19:04 user nova-compute[73158]:     <audio id='1' type='none'/>
Aug 17 10:19:04 user nova-compute[73158]:     <video>
Aug 17 10:19:04 user nova-compute[73158]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='video0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </video>
Aug 17 10:19:04 user nova-compute[73158]:     <memballoon model='virtio'>
Aug 17 10:19:04 user nova-compute[73158]:       <stats period='10'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='balloon0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:04 user nova-compute[73158]:     <rng model='virtio'>
Aug 17 10:19:04 user nova-compute[73158]:       <backend model='random'>/dev/urandom</backend>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='rng0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </rng>
Aug 17 10:19:04 user nova-compute[73158]:   </devices>
Aug 17 10:19:04 user nova-compute[73158]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 10:19:04 user nova-compute[73158]:     <label>libvirt-a43f242b-fdf6-4153-acad-344d28610631</label>
Aug 17 10:19:04 user nova-compute[73158]:     <imagelabel>libvirt-a43f242b-fdf6-4153-acad-344d28610631</imagelabel>
Aug 17 10:19:04 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:04 user nova-compute[73158]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 10:19:04 user nova-compute[73158]:     <label>+64055:+108</label>
Aug 17 10:19:04 user nova-compute[73158]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 10:19:04 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:04 user nova-compute[73158]: </domain>
Aug 17 10:19:04 user nova-compute[73158]:  {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 10:19:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully detached device tap1ac7ed64-41 from instance a43f242b-fdf6-4153-acad-344d28610631 from the persistent domain config.
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] (1/8): Attempting to detach device tap1ac7ed64-41 with device alias net1 from instance a43f242b-fdf6-4153-acad-344d28610631 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] detach device xml: <interface type="ethernet">
Aug 17 10:19:04 user nova-compute[73158]:   <mac address="fa:16:3e:52:fb:22"/>
Aug 17 10:19:04 user nova-compute[73158]:   <model type="virtio"/>
Aug 17 10:19:04 user nova-compute[73158]:   <mtu size="1442"/>
Aug 17 10:19:04 user nova-compute[73158]:   <target dev="tap1ac7ed64-41"/>
Aug 17 10:19:04 user nova-compute[73158]: </interface>
Aug 17 10:19:04 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Successfully created port: e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267544.6399348, a43f242b-fdf6-4153-acad-344d28610631 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Start waiting for the detach event from libvirt for device tap1ac7ed64-41 with device alias net1 for instance a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface> {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 10:19:04 user nova-compute[73158]:   <name>instance-00000011</name>
Aug 17 10:19:04 user nova-compute[73158]:   <uuid>a43f242b-fdf6-4153-acad-344d28610631</uuid>
Aug 17 10:19:04 user nova-compute[73158]:   <metadata>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:04 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:18:46</nova:creationTime>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:19:04 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:owner>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:owner>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:ports>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:19:04 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:19:04 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:port uuid="1ac7ed64-418b-4388-81ab-799ccbf414e0">
Aug 17 10:19:04 user nova-compute[73158]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Aug 17 10:19:04 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:ports>
Aug 17 10:19:04 user nova-compute[73158]: </nova:instance>
Aug 17 10:19:04 user nova-compute[73158]:   </metadata>
Aug 17 10:19:04 user nova-compute[73158]:   <memory unit='KiB'>524288</memory>
Aug 17 10:19:04 user nova-compute[73158]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 10:19:04 user nova-compute[73158]:   <vcpu placement='static'>1</vcpu>
Aug 17 10:19:04 user nova-compute[73158]:   <resource>
Aug 17 10:19:04 user nova-compute[73158]:     <partition>/machine</partition>
Aug 17 10:19:04 user nova-compute[73158]:   </resource>
Aug 17 10:19:04 user nova-compute[73158]:   <sysinfo type='smbios'>
Aug 17 10:19:04 user nova-compute[73158]:     <system>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='version'>0.0.0</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='serial'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='uuid'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:04 user nova-compute[73158]:       <entry name='family'>Virtual Machine</entry>
Aug 17 10:19:04 user nova-compute[73158]:     </system>
Aug 17 10:19:04 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:04 user nova-compute[73158]:   <os>
Aug 17 10:19:04 user nova-compute[73158]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 10:19:04 user nova-compute[73158]:     <boot dev='hd'/>
Aug 17 10:19:04 user nova-compute[73158]:     <smbios mode='sysinfo'/>
Aug 17 10:19:04 user nova-compute[73158]:   </os>
Aug 17 10:19:04 user nova-compute[73158]:   <features>
Aug 17 10:19:04 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:04 user nova-compute[73158]:     <apic/>
Aug 17 10:19:04 user nova-compute[73158]:     <vmcoreinfo state='on'/>
Aug 17 10:19:04 user nova-compute[73158]:   </features>
Aug 17 10:19:04 user nova-compute[73158]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 10:19:04 user nova-compute[73158]:     <model fallback='forbid'>Nehalem</model>
Aug 17 10:19:04 user nova-compute[73158]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 10:19:04 user nova-compute[73158]:     <feature policy='require' name='vme'/>
Aug 17 10:19:04 user nova-compute[73158]:     <feature policy='require' name='x2apic'/>
Aug 17 10:19:04 user nova-compute[73158]:     <feature policy='require' name='hypervisor'/>
Aug 17 10:19:04 user nova-compute[73158]:   </cpu>
Aug 17 10:19:04 user nova-compute[73158]:   <clock offset='utc'>
Aug 17 10:19:04 user nova-compute[73158]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 10:19:04 user nova-compute[73158]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 10:19:04 user nova-compute[73158]:     <timer name='hpet' present='no'/>
Aug 17 10:19:04 user nova-compute[73158]:   </clock>
Aug 17 10:19:04 user nova-compute[73158]:   <on_poweroff>destroy</on_poweroff>
Aug 17 10:19:04 user nova-compute[73158]:   <on_reboot>restart</on_reboot>
Aug 17 10:19:04 user nova-compute[73158]:   <on_crash>destroy</on_crash>
Aug 17 10:19:04 user nova-compute[73158]:   <devices>
Aug 17 10:19:04 user nova-compute[73158]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 10:19:04 user nova-compute[73158]:     <disk type='file' device='disk'>
Aug 17 10:19:04 user nova-compute[73158]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 10:19:04 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk' index='2'/>
Aug 17 10:19:04 user nova-compute[73158]:       <backingStore type='file' index='3'>
Aug 17 10:19:04 user nova-compute[73158]:         <format type='raw'/>
Aug 17 10:19:04 user nova-compute[73158]:         <source file='/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc'/>
Aug 17 10:19:04 user nova-compute[73158]:         <backingStore/>
Aug 17 10:19:04 user nova-compute[73158]:       </backingStore>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='vda' bus='virtio'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='virtio-disk0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </disk>
Aug 17 10:19:04 user nova-compute[73158]:     <disk type='file' device='cdrom'>
Aug 17 10:19:04 user nova-compute[73158]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 10:19:04 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config' index='1'/>
Aug 17 10:19:04 user nova-compute[73158]:       <backingStore/>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='hda' bus='ide'/>
Aug 17 10:19:04 user nova-compute[73158]:       <readonly/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='ide0-0-0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </disk>
Aug 17 10:19:04 user nova-compute[73158]:     <controller type='usb' index='0' model='none'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='usb'/>
Aug 17 10:19:04 user nova-compute[73158]:     </controller>
Aug 17 10:19:04 user nova-compute[73158]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='pci.0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </controller>
Aug 17 10:19:04 user nova-compute[73158]:     <controller type='ide' index='0'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='ide'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 10:19:04 user nova-compute[73158]:     </controller>
Aug 17 10:19:04 user nova-compute[73158]:     <interface type='ethernet'>
Aug 17 10:19:04 user nova-compute[73158]:       <mac address='fa:16:3e:ba:87:a1'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target dev='tap6a4f2143-f2'/>
Aug 17 10:19:04 user nova-compute[73158]:       <model type='virtio'/>
Aug 17 10:19:04 user nova-compute[73158]:       <mtu size='1442'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='net0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </interface>
Aug 17 10:19:04 user nova-compute[73158]:     <serial type='pty'>
Aug 17 10:19:04 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:04 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target type='isa-serial' port='0'>
Aug 17 10:19:04 user nova-compute[73158]:         <model name='isa-serial'/>
Aug 17 10:19:04 user nova-compute[73158]:       </target>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </serial>
Aug 17 10:19:04 user nova-compute[73158]:     <console type='pty' tty='/dev/pts/10'>
Aug 17 10:19:04 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:04 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:04 user nova-compute[73158]:       <target type='serial' port='0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </console>
Aug 17 10:19:04 user nova-compute[73158]:     <input type='mouse' bus='ps2'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='input0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </input>
Aug 17 10:19:04 user nova-compute[73158]:     <input type='keyboard' bus='ps2'>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='input1'/>
Aug 17 10:19:04 user nova-compute[73158]:     </input>
Aug 17 10:19:04 user nova-compute[73158]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 17 10:19:04 user nova-compute[73158]:       <listen type='address' address='0.0.0.0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </graphics>
Aug 17 10:19:04 user nova-compute[73158]:     <audio id='1' type='none'/>
Aug 17 10:19:04 user nova-compute[73158]:     <video>
Aug 17 10:19:04 user nova-compute[73158]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='video0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </video>
Aug 17 10:19:04 user nova-compute[73158]:     <memballoon model='virtio'>
Aug 17 10:19:04 user nova-compute[73158]:       <stats period='10'/>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='balloon0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:04 user nova-compute[73158]:     <rng model='virtio'>
Aug 17 10:19:04 user nova-compute[73158]:       <backend model='random'>/dev/urandom</backend>
Aug 17 10:19:04 user nova-compute[73158]:       <alias name='rng0'/>
Aug 17 10:19:04 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 10:19:04 user nova-compute[73158]:     </rng>
Aug 17 10:19:04 user nova-compute[73158]:   </devices>
Aug 17 10:19:04 user nova-compute[73158]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 10:19:04 user nova-compute[73158]:     <label>libvirt-a43f242b-fdf6-4153-acad-344d28610631</label>
Aug 17 10:19:04 user nova-compute[73158]:     <imagelabel>libvirt-a43f242b-fdf6-4153-acad-344d28610631</imagelabel>
Aug 17 10:19:04 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:04 user nova-compute[73158]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 10:19:04 user nova-compute[73158]:     <label>+64055:+108</label>
Aug 17 10:19:04 user nova-compute[73158]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 10:19:04 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:04 user nova-compute[73158]: </domain>
Aug 17 10:19:04 user nova-compute[73158]:  {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 10:19:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully detached device tap1ac7ed64-41 from instance a43f242b-fdf6-4153-acad-344d28610631 from the live domain config.
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG os_vif [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ac7ed64-41, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:04 user nova-compute[73158]: INFO os_vif [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41')
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:04 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:19:04</nova:creationTime>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:19:04 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:owner>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:owner>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:04 user nova-compute[73158]:   <nova:ports>
Aug 17 10:19:04 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:19:04 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:19:04 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:04 user nova-compute[73158]:   </nova:ports>
Aug 17 10:19:04 user nova-compute[73158]: </nova:instance>
Aug 17 10:19:04 user nova-compute[73158]:  {{(pid=73158) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-31ed03e2-76af-4b0a-9807-c8e763bb31e7 req-07f72467-0d6e-4953-a7d5-92ea998d7e82 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-unplugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-31ed03e2-76af-4b0a-9807-c8e763bb31e7 req-07f72467-0d6e-4953-a7d5-92ea998d7e82 service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-31ed03e2-76af-4b0a-9807-c8e763bb31e7 req-07f72467-0d6e-4953-a7d5-92ea998d7e82 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-31ed03e2-76af-4b0a-9807-c8e763bb31e7 req-07f72467-0d6e-4953-a7d5-92ea998d7e82 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-31ed03e2-76af-4b0a-9807-c8e763bb31e7 req-07f72467-0d6e-4953-a7d5-92ea998d7e82 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-unplugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:04 user nova-compute[73158]: WARNING nova.compute.manager [req-31ed03e2-76af-4b0a-9807-c8e763bb31e7 req-07f72467-0d6e-4953-a7d5-92ea998d7e82 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-unplugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 for instance with vm_state active and task_state None.
Aug 17 10:19:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-deleted-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:05 user nova-compute[73158]: INFO nova.compute.manager [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Neutron deleted interface 1ac7ed64-418b-4388-81ab-799ccbf414e0; detaching it from the instance and deleting it from the info cache
Aug 17 10:19:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquired lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:19:05 user nova-compute[73158]: DEBUG nova.objects.instance [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Lazy-loading 'system_metadata' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.objects.instance [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Lazy-loading 'flavor' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Successfully updated port: e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquired lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Converting VIF {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface> {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 10:19:06 user nova-compute[73158]:   <name>instance-00000011</name>
Aug 17 10:19:06 user nova-compute[73158]:   <uuid>a43f242b-fdf6-4153-acad-344d28610631</uuid>
Aug 17 10:19:06 user nova-compute[73158]:   <metadata>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:06 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:19:04</nova:creationTime>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:19:06 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:ports>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:19:06 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:19:06 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:ports>
Aug 17 10:19:06 user nova-compute[73158]: </nova:instance>
Aug 17 10:19:06 user nova-compute[73158]:   </metadata>
Aug 17 10:19:06 user nova-compute[73158]:   <memory unit='KiB'>524288</memory>
Aug 17 10:19:06 user nova-compute[73158]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 10:19:06 user nova-compute[73158]:   <vcpu placement='static'>1</vcpu>
Aug 17 10:19:06 user nova-compute[73158]:   <resource>
Aug 17 10:19:06 user nova-compute[73158]:     <partition>/machine</partition>
Aug 17 10:19:06 user nova-compute[73158]:   </resource>
Aug 17 10:19:06 user nova-compute[73158]:   <sysinfo type='smbios'>
Aug 17 10:19:06 user nova-compute[73158]:     <system>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='version'>0.0.0</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='serial'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='uuid'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='family'>Virtual Machine</entry>
Aug 17 10:19:06 user nova-compute[73158]:     </system>
Aug 17 10:19:06 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:06 user nova-compute[73158]:   <os>
Aug 17 10:19:06 user nova-compute[73158]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 10:19:06 user nova-compute[73158]:     <boot dev='hd'/>
Aug 17 10:19:06 user nova-compute[73158]:     <smbios mode='sysinfo'/>
Aug 17 10:19:06 user nova-compute[73158]:   </os>
Aug 17 10:19:06 user nova-compute[73158]:   <features>
Aug 17 10:19:06 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:06 user nova-compute[73158]:     <apic/>
Aug 17 10:19:06 user nova-compute[73158]:     <vmcoreinfo state='on'/>
Aug 17 10:19:06 user nova-compute[73158]:   </features>
Aug 17 10:19:06 user nova-compute[73158]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 10:19:06 user nova-compute[73158]:     <model fallback='forbid'>Nehalem</model>
Aug 17 10:19:06 user nova-compute[73158]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 10:19:06 user nova-compute[73158]:     <feature policy='require' name='vme'/>
Aug 17 10:19:06 user nova-compute[73158]:     <feature policy='require' name='x2apic'/>
Aug 17 10:19:06 user nova-compute[73158]:     <feature policy='require' name='hypervisor'/>
Aug 17 10:19:06 user nova-compute[73158]:   </cpu>
Aug 17 10:19:06 user nova-compute[73158]:   <clock offset='utc'>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name='hpet' present='no'/>
Aug 17 10:19:06 user nova-compute[73158]:   </clock>
Aug 17 10:19:06 user nova-compute[73158]:   <on_poweroff>destroy</on_poweroff>
Aug 17 10:19:06 user nova-compute[73158]:   <on_reboot>restart</on_reboot>
Aug 17 10:19:06 user nova-compute[73158]:   <on_crash>destroy</on_crash>
Aug 17 10:19:06 user nova-compute[73158]:   <devices>
Aug 17 10:19:06 user nova-compute[73158]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 10:19:06 user nova-compute[73158]:     <disk type='file' device='disk'>
Aug 17 10:19:06 user nova-compute[73158]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 10:19:06 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk' index='2'/>
Aug 17 10:19:06 user nova-compute[73158]:       <backingStore type='file' index='3'>
Aug 17 10:19:06 user nova-compute[73158]:         <format type='raw'/>
Aug 17 10:19:06 user nova-compute[73158]:         <source file='/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc'/>
Aug 17 10:19:06 user nova-compute[73158]:         <backingStore/>
Aug 17 10:19:06 user nova-compute[73158]:       </backingStore>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev='vda' bus='virtio'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='virtio-disk0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </disk>
Aug 17 10:19:06 user nova-compute[73158]:     <disk type='file' device='cdrom'>
Aug 17 10:19:06 user nova-compute[73158]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 10:19:06 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config' index='1'/>
Aug 17 10:19:06 user nova-compute[73158]:       <backingStore/>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev='hda' bus='ide'/>
Aug 17 10:19:06 user nova-compute[73158]:       <readonly/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='ide0-0-0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </disk>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type='usb' index='0' model='none'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='usb'/>
Aug 17 10:19:06 user nova-compute[73158]:     </controller>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='pci.0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </controller>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type='ide' index='0'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='ide'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 10:19:06 user nova-compute[73158]:     </controller>
Aug 17 10:19:06 user nova-compute[73158]:     <interface type='ethernet'>
Aug 17 10:19:06 user nova-compute[73158]:       <mac address='fa:16:3e:ba:87:a1'/>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev='tap6a4f2143-f2'/>
Aug 17 10:19:06 user nova-compute[73158]:       <model type='virtio'/>
Aug 17 10:19:06 user nova-compute[73158]:       <mtu size='1442'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='net0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </interface>
Aug 17 10:19:06 user nova-compute[73158]:     <serial type='pty'>
Aug 17 10:19:06 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:06 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:06 user nova-compute[73158]:       <target type='isa-serial' port='0'>
Aug 17 10:19:06 user nova-compute[73158]:         <model name='isa-serial'/>
Aug 17 10:19:06 user nova-compute[73158]:       </target>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </serial>
Aug 17 10:19:06 user nova-compute[73158]:     <console type='pty' tty='/dev/pts/10'>
Aug 17 10:19:06 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:06 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:06 user nova-compute[73158]:       <target type='serial' port='0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </console>
Aug 17 10:19:06 user nova-compute[73158]:     <input type='mouse' bus='ps2'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='input0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </input>
Aug 17 10:19:06 user nova-compute[73158]:     <input type='keyboard' bus='ps2'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='input1'/>
Aug 17 10:19:06 user nova-compute[73158]:     </input>
Aug 17 10:19:06 user nova-compute[73158]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 17 10:19:06 user nova-compute[73158]:       <listen type='address' address='0.0.0.0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </graphics>
Aug 17 10:19:06 user nova-compute[73158]:     <audio id='1' type='none'/>
Aug 17 10:19:06 user nova-compute[73158]:     <video>
Aug 17 10:19:06 user nova-compute[73158]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='video0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </video>
Aug 17 10:19:06 user nova-compute[73158]:     <memballoon model='virtio'>
Aug 17 10:19:06 user nova-compute[73158]:       <stats period='10'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='balloon0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:06 user nova-compute[73158]:     <rng model='virtio'>
Aug 17 10:19:06 user nova-compute[73158]:       <backend model='random'>/dev/urandom</backend>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='rng0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </rng>
Aug 17 10:19:06 user nova-compute[73158]:   </devices>
Aug 17 10:19:06 user nova-compute[73158]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 10:19:06 user nova-compute[73158]:     <label>libvirt-a43f242b-fdf6-4153-acad-344d28610631</label>
Aug 17 10:19:06 user nova-compute[73158]:     <imagelabel>libvirt-a43f242b-fdf6-4153-acad-344d28610631</imagelabel>
Aug 17 10:19:06 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:06 user nova-compute[73158]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 10:19:06 user nova-compute[73158]:     <label>+64055:+108</label>
Aug 17 10:19:06 user nova-compute[73158]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 10:19:06 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:06 user nova-compute[73158]: </domain>
Aug 17 10:19:06 user nova-compute[73158]:  {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface> {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:fb:22"/><model type="virtio"/><mtu size="1442"/><target dev="tap1ac7ed64-41"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 10:19:06 user nova-compute[73158]:   <name>instance-00000011</name>
Aug 17 10:19:06 user nova-compute[73158]:   <uuid>a43f242b-fdf6-4153-acad-344d28610631</uuid>
Aug 17 10:19:06 user nova-compute[73158]:   <metadata>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:06 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:19:04</nova:creationTime>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:19:06 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:ports>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:19:06 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:19:06 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:ports>
Aug 17 10:19:06 user nova-compute[73158]: </nova:instance>
Aug 17 10:19:06 user nova-compute[73158]:   </metadata>
Aug 17 10:19:06 user nova-compute[73158]:   <memory unit='KiB'>524288</memory>
Aug 17 10:19:06 user nova-compute[73158]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 10:19:06 user nova-compute[73158]:   <vcpu placement='static'>1</vcpu>
Aug 17 10:19:06 user nova-compute[73158]:   <resource>
Aug 17 10:19:06 user nova-compute[73158]:     <partition>/machine</partition>
Aug 17 10:19:06 user nova-compute[73158]:   </resource>
Aug 17 10:19:06 user nova-compute[73158]:   <sysinfo type='smbios'>
Aug 17 10:19:06 user nova-compute[73158]:     <system>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='version'>0.0.0</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='serial'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='uuid'>a43f242b-fdf6-4153-acad-344d28610631</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name='family'>Virtual Machine</entry>
Aug 17 10:19:06 user nova-compute[73158]:     </system>
Aug 17 10:19:06 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:06 user nova-compute[73158]:   <os>
Aug 17 10:19:06 user nova-compute[73158]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 10:19:06 user nova-compute[73158]:     <boot dev='hd'/>
Aug 17 10:19:06 user nova-compute[73158]:     <smbios mode='sysinfo'/>
Aug 17 10:19:06 user nova-compute[73158]:   </os>
Aug 17 10:19:06 user nova-compute[73158]:   <features>
Aug 17 10:19:06 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:06 user nova-compute[73158]:     <apic/>
Aug 17 10:19:06 user nova-compute[73158]:     <vmcoreinfo state='on'/>
Aug 17 10:19:06 user nova-compute[73158]:   </features>
Aug 17 10:19:06 user nova-compute[73158]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 10:19:06 user nova-compute[73158]:     <model fallback='forbid'>Nehalem</model>
Aug 17 10:19:06 user nova-compute[73158]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 10:19:06 user nova-compute[73158]:     <feature policy='require' name='vme'/>
Aug 17 10:19:06 user nova-compute[73158]:     <feature policy='require' name='x2apic'/>
Aug 17 10:19:06 user nova-compute[73158]:     <feature policy='require' name='hypervisor'/>
Aug 17 10:19:06 user nova-compute[73158]:   </cpu>
Aug 17 10:19:06 user nova-compute[73158]:   <clock offset='utc'>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name='hpet' present='no'/>
Aug 17 10:19:06 user nova-compute[73158]:   </clock>
Aug 17 10:19:06 user nova-compute[73158]:   <on_poweroff>destroy</on_poweroff>
Aug 17 10:19:06 user nova-compute[73158]:   <on_reboot>restart</on_reboot>
Aug 17 10:19:06 user nova-compute[73158]:   <on_crash>destroy</on_crash>
Aug 17 10:19:06 user nova-compute[73158]:   <devices>
Aug 17 10:19:06 user nova-compute[73158]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 10:19:06 user nova-compute[73158]:     <disk type='file' device='disk'>
Aug 17 10:19:06 user nova-compute[73158]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 10:19:06 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk' index='2'/>
Aug 17 10:19:06 user nova-compute[73158]:       <backingStore type='file' index='3'>
Aug 17 10:19:06 user nova-compute[73158]:         <format type='raw'/>
Aug 17 10:19:06 user nova-compute[73158]:         <source file='/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc'/>
Aug 17 10:19:06 user nova-compute[73158]:         <backingStore/>
Aug 17 10:19:06 user nova-compute[73158]:       </backingStore>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev='vda' bus='virtio'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='virtio-disk0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </disk>
Aug 17 10:19:06 user nova-compute[73158]:     <disk type='file' device='cdrom'>
Aug 17 10:19:06 user nova-compute[73158]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 10:19:06 user nova-compute[73158]:       <source file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk.config' index='1'/>
Aug 17 10:19:06 user nova-compute[73158]:       <backingStore/>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev='hda' bus='ide'/>
Aug 17 10:19:06 user nova-compute[73158]:       <readonly/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='ide0-0-0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </disk>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type='usb' index='0' model='none'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='usb'/>
Aug 17 10:19:06 user nova-compute[73158]:     </controller>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='pci.0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </controller>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type='ide' index='0'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='ide'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 10:19:06 user nova-compute[73158]:     </controller>
Aug 17 10:19:06 user nova-compute[73158]:     <interface type='ethernet'>
Aug 17 10:19:06 user nova-compute[73158]:       <mac address='fa:16:3e:ba:87:a1'/>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev='tap6a4f2143-f2'/>
Aug 17 10:19:06 user nova-compute[73158]:       <model type='virtio'/>
Aug 17 10:19:06 user nova-compute[73158]:       <mtu size='1442'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='net0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </interface>
Aug 17 10:19:06 user nova-compute[73158]:     <serial type='pty'>
Aug 17 10:19:06 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:06 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:06 user nova-compute[73158]:       <target type='isa-serial' port='0'>
Aug 17 10:19:06 user nova-compute[73158]:         <model name='isa-serial'/>
Aug 17 10:19:06 user nova-compute[73158]:       </target>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </serial>
Aug 17 10:19:06 user nova-compute[73158]:     <console type='pty' tty='/dev/pts/10'>
Aug 17 10:19:06 user nova-compute[73158]:       <source path='/dev/pts/10'/>
Aug 17 10:19:06 user nova-compute[73158]:       <log file='/opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/console.log' append='off'/>
Aug 17 10:19:06 user nova-compute[73158]:       <target type='serial' port='0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='serial0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </console>
Aug 17 10:19:06 user nova-compute[73158]:     <input type='mouse' bus='ps2'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='input0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </input>
Aug 17 10:19:06 user nova-compute[73158]:     <input type='keyboard' bus='ps2'>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='input1'/>
Aug 17 10:19:06 user nova-compute[73158]:     </input>
Aug 17 10:19:06 user nova-compute[73158]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 17 10:19:06 user nova-compute[73158]:       <listen type='address' address='0.0.0.0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </graphics>
Aug 17 10:19:06 user nova-compute[73158]:     <audio id='1' type='none'/>
Aug 17 10:19:06 user nova-compute[73158]:     <video>
Aug 17 10:19:06 user nova-compute[73158]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='video0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </video>
Aug 17 10:19:06 user nova-compute[73158]:     <memballoon model='virtio'>
Aug 17 10:19:06 user nova-compute[73158]:       <stats period='10'/>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='balloon0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:06 user nova-compute[73158]:     <rng model='virtio'>
Aug 17 10:19:06 user nova-compute[73158]:       <backend model='random'>/dev/urandom</backend>
Aug 17 10:19:06 user nova-compute[73158]:       <alias name='rng0'/>
Aug 17 10:19:06 user nova-compute[73158]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 10:19:06 user nova-compute[73158]:     </rng>
Aug 17 10:19:06 user nova-compute[73158]:   </devices>
Aug 17 10:19:06 user nova-compute[73158]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 10:19:06 user nova-compute[73158]:     <label>libvirt-a43f242b-fdf6-4153-acad-344d28610631</label>
Aug 17 10:19:06 user nova-compute[73158]:     <imagelabel>libvirt-a43f242b-fdf6-4153-acad-344d28610631</imagelabel>
Aug 17 10:19:06 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:06 user nova-compute[73158]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 10:19:06 user nova-compute[73158]:     <label>+64055:+108</label>
Aug 17 10:19:06 user nova-compute[73158]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 10:19:06 user nova-compute[73158]:   </seclabel>
Aug 17 10:19:06 user nova-compute[73158]: </domain>
Aug 17 10:19:06 user nova-compute[73158]:  {{(pid=73158) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 10:19:06 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Detaching interface fa:16:3e:52:fb:22 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap1ac7ed64-41' not found.
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Converting VIF {"id": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "address": "fa:16:3e:52:fb:22", "network": {"id": "cb342284-2e95-4b8b-aab7-d9df5e2af7a4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1376817275", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac7ed64-41", "ovs_interfaceid": "1ac7ed64-418b-4388-81ab-799ccbf414e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG os_vif [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ac7ed64-41, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:19:06 user nova-compute[73158]: INFO os_vif [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fb:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac7ed64-418b-4388-81ab-799ccbf414e0,network=Network(cb342284-2e95-4b8b-aab7-d9df5e2af7a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac7ed64-41')
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [req-1f515246-60c2-4d75-aa7f-55be89c02972 req-b00c5187-8bab-48dd-b2ac-a8a17c2c2ce8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:06 user nova-compute[73158]:   <nova:package version="0.0.0"/>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:name>tempest-device-tagging-server-1354213922</nova:name>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:creationTime>2023-08-17 10:19:06</nova:creationTime>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:flavor name="m1.tiny">
Aug 17 10:19:06 user nova-compute[73158]:     <nova:memory>512</nova:memory>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:disk>1</nova:disk>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:swap>0</nova:swap>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:flavor>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:user uuid="6d012173c11e42e090143411f4d9f34e">tempest-TaggedAttachmentsTest-1938903503-project-member</nova:user>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:project uuid="eb17cb60c0714fabb50a01bafaf56a6a">tempest-TaggedAttachmentsTest-1938903503</nova:project>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:06 user nova-compute[73158]:   <nova:ports>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:port uuid="6a4f2143-f2bd-4467-a926-244b2dc8aedd">
Aug 17 10:19:06 user nova-compute[73158]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:19:06 user nova-compute[73158]:     </nova:port>
Aug 17 10:19:06 user nova-compute[73158]:   </nova:ports>
Aug 17 10:19:06 user nova-compute[73158]: </nova:instance>
Aug 17 10:19:06 user nova-compute[73158]:  {{(pid=73158) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updating instance_info_cache with network_info: [{"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Releasing lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Instance network_info: |[{"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Start _get_guest_xml network_info=[{"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [{"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:06 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:06 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-254226682',display_name='tempest-TestStampPattern-server-254226682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-254226682',id=22,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6XIxP0dCINXqjELSrLNjFiRC+1PldH0AChmBMJ5HNVC3DRW7UR8eVYRzITonCUhH/MtY84G5Nh9wiITQ8XKcYuD0UbRRpWG4DHpqdPsono5MbPBjUhIFJKYjWAejQNwg==',key_name='tempest-TestStampPattern-863239552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8d6d6113124771be6093c99e106c18',ramdisk_id='',reservation_id='r-zaams6cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1495454869',owner_user_name='tempest-TestStampPattern-1495454869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:03Z,user_data=None,user_id='908f0da6a47c4ba295fee97cf4e88234',uuid=d2dbefd6-afaf-4446-977f-69c0ead85a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converting VIF {"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.objects.instance [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'pci_devices' on Instance uuid d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Releasing lock "refresh_cache-a43f242b-fdf6-4153-acad-344d28610631" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:19:06 user nova-compute[73158]:   <uuid>d2dbefd6-afaf-4446-977f-69c0ead85a01</uuid>
Aug 17 10:19:06 user nova-compute[73158]:   <name>instance-00000016</name>
Aug 17 10:19:06 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:19:06 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:19:06 user nova-compute[73158]:   <metadata>
Aug 17 10:19:06 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:06 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:19:06 user nova-compute[73158]:       <nova:name>tempest-TestStampPattern-server-254226682</nova:name>
Aug 17 10:19:06 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:19:06</nova:creationTime>
Aug 17 10:19:06 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:19:06 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:06 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:19:06 user nova-compute[73158]:       <nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:user uuid="908f0da6a47c4ba295fee97cf4e88234">tempest-TestStampPattern-1495454869-project-member</nova:user>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:project uuid="cf8d6d6113124771be6093c99e106c18">tempest-TestStampPattern-1495454869</nova:project>
Aug 17 10:19:06 user nova-compute[73158]:       </nova:owner>
Aug 17 10:19:06 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:06 user nova-compute[73158]:       <nova:ports>
Aug 17 10:19:06 user nova-compute[73158]:         <nova:port uuid="e7e169e7-a1ff-486a-b2f5-ef7ef823dd64">
Aug 17 10:19:06 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:19:06 user nova-compute[73158]:         </nova:port>
Aug 17 10:19:06 user nova-compute[73158]:       </nova:ports>
Aug 17 10:19:06 user nova-compute[73158]:     </nova:instance>
Aug 17 10:19:06 user nova-compute[73158]:   </metadata>
Aug 17 10:19:06 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:19:06 user nova-compute[73158]:     <system>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name="serial">d2dbefd6-afaf-4446-977f-69c0ead85a01</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name="uuid">d2dbefd6-afaf-4446-977f-69c0ead85a01</entry>
Aug 17 10:19:06 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:19:06 user nova-compute[73158]:     </system>
Aug 17 10:19:06 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:06 user nova-compute[73158]:   <os>
Aug 17 10:19:06 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:19:06 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:19:06 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:19:06 user nova-compute[73158]:   </os>
Aug 17 10:19:06 user nova-compute[73158]:   <features>
Aug 17 10:19:06 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:06 user nova-compute[73158]:     <apic/>
Aug 17 10:19:06 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:19:06 user nova-compute[73158]:   </features>
Aug 17 10:19:06 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:19:06 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:19:06 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:19:06 user nova-compute[73158]:   </clock>
Aug 17 10:19:06 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:19:06 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:19:06 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:19:06 user nova-compute[73158]:   </cpu>
Aug 17 10:19:06 user nova-compute[73158]:   <devices>
Aug 17 10:19:06 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:19:06 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:19:06 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk"/>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:19:06 user nova-compute[73158]:     </disk>
Aug 17 10:19:06 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:19:06 user nova-compute[73158]:       <mac address="fa:16:3e:34:7d:53"/>
Aug 17 10:19:06 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:19:06 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:19:06 user nova-compute[73158]:       <target dev="tape7e169e7-a1"/>
Aug 17 10:19:06 user nova-compute[73158]:     </interface>
Aug 17 10:19:06 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:19:06 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/console.log" append="off"/>
Aug 17 10:19:06 user nova-compute[73158]:     </serial>
Aug 17 10:19:06 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:19:06 user nova-compute[73158]:     <video>
Aug 17 10:19:06 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:19:06 user nova-compute[73158]:     </video>
Aug 17 10:19:06 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:19:06 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:19:06 user nova-compute[73158]:     </rng>
Aug 17 10:19:06 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:19:06 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:19:06 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:19:06 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:06 user nova-compute[73158]:   </devices>
Aug 17 10:19:06 user nova-compute[73158]: </domain>
Aug 17 10:19:06 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-254226682',display_name='tempest-TestStampPattern-server-254226682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-254226682',id=22,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6XIxP0dCINXqjELSrLNjFiRC+1PldH0AChmBMJ5HNVC3DRW7UR8eVYRzITonCUhH/MtY84G5Nh9wiITQ8XKcYuD0UbRRpWG4DHpqdPsono5MbPBjUhIFJKYjWAejQNwg==',key_name='tempest-TestStampPattern-863239552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8d6d6113124771be6093c99e106c18',ramdisk_id='',reservation_id='r-zaams6cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1495454869',owner_user_name='tempest-TestStampPattern-1495454869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:03Z,user_data=None,user_id='908f0da6a47c4ba295fee97cf4e88234',uuid=d2dbefd6-afaf-4446-977f-69c0ead85a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converting VIF {"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG os_vif [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7e169e7-a1, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7e169e7-a1, col_values=(('external_ids', {'iface-id': 'e7e169e7-a1ff-486a-b2f5-ef7ef823dd64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:7d:53', 'vm-uuid': 'd2dbefd6-afaf-4446-977f-69c0ead85a01'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9dfd8afd-a6dc-458f-957f-f33b86c03842 tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "interface-a43f242b-fdf6-4153-acad-344d28610631-1ac7ed64-418b-4388-81ab-799ccbf414e0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.498s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:06 user nova-compute[73158]: INFO os_vif [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1')
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No VIF found with MAC fa:16:3e:34:7d:53, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a0041b4-554b-4037-b6cd-a654b4842c11 req-8ed24ed9-88ae-453e-9f72-7d7c81d949f3 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a0041b4-554b-4037-b6cd-a654b4842c11 req-8ed24ed9-88ae-453e-9f72-7d7c81d949f3 service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a0041b4-554b-4037-b6cd-a654b4842c11 req-8ed24ed9-88ae-453e-9f72-7d7c81d949f3 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a0041b4-554b-4037-b6cd-a654b4842c11 req-8ed24ed9-88ae-453e-9f72-7d7c81d949f3 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a0041b4-554b-4037-b6cd-a654b4842c11 req-8ed24ed9-88ae-453e-9f72-7d7c81d949f3 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:06 user nova-compute[73158]: WARNING nova.compute.manager [req-3a0041b4-554b-4037-b6cd-a654b4842c11 req-8ed24ed9-88ae-453e-9f72-7d7c81d949f3 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-plugged-1ac7ed64-418b-4388-81ab-799ccbf414e0 for instance with vm_state active and task_state None.
Aug 17 10:19:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-changed-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Refreshing instance network info cache due to event network-changed-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:19:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] Acquiring lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] Acquired lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Refreshing network info cache for port e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updated VIF entry in instance network info cache for port e7e169e7-a1ff-486a-b2f5-ef7ef823dd64. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updating instance_info_cache with network_info: [{"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5471bc26-acb4-42ac-be25-29f2403e2338 req-16d28315-cb6e-4f44-b3c8-23b93a67fc19 service nova] Releasing lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] No waiting events found dispatching network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:08 user nova-compute[73158]: WARNING nova.compute.manager [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received unexpected event network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 for instance with vm_state building and task_state spawning.
Aug 17 10:19:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] No waiting events found dispatching network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:08 user nova-compute[73158]: WARNING nova.compute.manager [req-8c5a7b3e-a0fc-4378-a0cd-70bed1fb26dc req-d64e2a82-1227-4549-b5bb-c9b86f011fc4 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received unexpected event network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 for instance with vm_state building and task_state spawning.
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing instance network info cache due to event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267550.2753327, d2dbefd6-afaf-4446-977f-69c0ead85a01 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] VM Resumed (Lifecycle Event)
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Instance spawned successfully.
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267550.2871928, d2dbefd6-afaf-4446-977f-69c0ead85a01 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] VM Started (Lifecycle Event)
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:10 user nova-compute[73158]: INFO nova.compute.manager [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Took 8.13 seconds to build instance.
Aug 17 10:19:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93996398-653a-45f1-9ee0-e83aa4441c6f tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.231s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updated VIF entry in instance network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5b0e2f8e-b3a6-41c4-9354-b1bbbae4c4ae req-5272d32c-3bc0-468a-8a8f-61d028a00cdb service nova] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:11 user nova-compute[73158]: INFO nova.compute.manager [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] instance snapshotting
Aug 17 10:19:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Beginning live snapshot process
Aug 17 10:19:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1qn2p62x/bc3a77a752084691817bf9713b73bbe7.delta 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1qn2p62x/bc3a77a752084691817bf9713b73bbe7.delta 1073741824" returned: 0 in 0.048s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 10:19:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] COPY block job progress, current cursor: 262144 final cursor: 75563008 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:19:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] COPY block job progress, current cursor: 24903680 final cursor: 75563008 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:19:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:19:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 10:19:14 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:19:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1qn2p62x/bc3a77a752084691817bf9713b73bbe7.delta /opt/stack/data/nova/instances/snapshots/tmp1qn2p62x/bc3a77a752084691817bf9713b73bbe7 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1qn2p62x/bc3a77a752084691817bf9713b73bbe7.delta /opt/stack/data/nova/instances/snapshots/tmp1qn2p62x/bc3a77a752084691817bf9713b73bbe7" returned: 0 in 0.373s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Snapshot extracted, beginning image upload
Aug 17 10:19:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:19:16 user nova-compute[73158]: INFO nova.compute.claims [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Claim successful on node user
Aug 17 10:19:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:19:16 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.policy [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1230fe2ff59346c7a312ef772820cab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ec620087724665b6218bb575bfcbef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:19:16 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Creating image(s)
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Snapshot image upload complete
Aug 17 10:19:17 user nova-compute[73158]: INFO nova.compute.manager [None req-e4f0e7c4-0c17-4413-a303-26f228217b7c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Took 5.90 seconds to snapshot the instance on the hypervisor.
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk 1073741824" returned: 0 in 0.070s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Successfully created port: e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Cannot resize image /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'migration_context' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Ensure instance console log exists: /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Successfully updated port: e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquired lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-changed-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Refreshing instance network info cache due to event network-changed-e4639473-b396-4d8c-aadc-30d8e10252cb. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] Acquiring lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Releasing lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance network_info: |[{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] Acquired lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.neutron [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Refreshing network info cache for port e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start _get_guest_xml network_info=[{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:19:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'pci_devices' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:19:18 user nova-compute[73158]:   <uuid>a6744f73-a7ec-4388-8e15-c05068041a09</uuid>
Aug 17 10:19:18 user nova-compute[73158]:   <name>instance-00000017</name>
Aug 17 10:19:18 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:19:18 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:19:18 user nova-compute[73158]:   <metadata>
Aug 17 10:19:18 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:18 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:19:18 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeTestJSON-server-1347333996</nova:name>
Aug 17 10:19:18 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:19:18</nova:creationTime>
Aug 17 10:19:18 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:19:18 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:18 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:19:18 user nova-compute[73158]:       <nova:owner>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:user uuid="1230fe2ff59346c7a312ef772820cab1">tempest-AttachVolumeTestJSON-1679631742-project-member</nova:user>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:project uuid="d6ec620087724665b6218bb575bfcbef">tempest-AttachVolumeTestJSON-1679631742</nova:project>
Aug 17 10:19:18 user nova-compute[73158]:       </nova:owner>
Aug 17 10:19:18 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:18 user nova-compute[73158]:       <nova:ports>
Aug 17 10:19:18 user nova-compute[73158]:         <nova:port uuid="e4639473-b396-4d8c-aadc-30d8e10252cb">
Aug 17 10:19:18 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:19:18 user nova-compute[73158]:         </nova:port>
Aug 17 10:19:18 user nova-compute[73158]:       </nova:ports>
Aug 17 10:19:18 user nova-compute[73158]:     </nova:instance>
Aug 17 10:19:18 user nova-compute[73158]:   </metadata>
Aug 17 10:19:18 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:19:18 user nova-compute[73158]:     <system>
Aug 17 10:19:18 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:19:18 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:19:18 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:19:18 user nova-compute[73158]:       <entry name="serial">a6744f73-a7ec-4388-8e15-c05068041a09</entry>
Aug 17 10:19:18 user nova-compute[73158]:       <entry name="uuid">a6744f73-a7ec-4388-8e15-c05068041a09</entry>
Aug 17 10:19:18 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:19:18 user nova-compute[73158]:     </system>
Aug 17 10:19:18 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:18 user nova-compute[73158]:   <os>
Aug 17 10:19:18 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:19:18 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:19:18 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:19:18 user nova-compute[73158]:   </os>
Aug 17 10:19:18 user nova-compute[73158]:   <features>
Aug 17 10:19:18 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:18 user nova-compute[73158]:     <apic/>
Aug 17 10:19:18 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:19:18 user nova-compute[73158]:   </features>
Aug 17 10:19:18 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:19:18 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:19:18 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:19:18 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:19:18 user nova-compute[73158]:   </clock>
Aug 17 10:19:18 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:19:18 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:19:18 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:19:18 user nova-compute[73158]:   </cpu>
Aug 17 10:19:18 user nova-compute[73158]:   <devices>
Aug 17 10:19:18 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:19:18 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:19:18 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk"/>
Aug 17 10:19:18 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:19:18 user nova-compute[73158]:     </disk>
Aug 17 10:19:18 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:19:18 user nova-compute[73158]:       <mac address="fa:16:3e:c1:86:11"/>
Aug 17 10:19:18 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:19:18 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:19:18 user nova-compute[73158]:       <target dev="tape4639473-b3"/>
Aug 17 10:19:18 user nova-compute[73158]:     </interface>
Aug 17 10:19:18 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:19:18 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/console.log" append="off"/>
Aug 17 10:19:18 user nova-compute[73158]:     </serial>
Aug 17 10:19:18 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:19:18 user nova-compute[73158]:     <video>
Aug 17 10:19:18 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:19:18 user nova-compute[73158]:     </video>
Aug 17 10:19:18 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:19:18 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:19:18 user nova-compute[73158]:     </rng>
Aug 17 10:19:18 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:19:18 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:19:18 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:19:18 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:18 user nova-compute[73158]:   </devices>
Aug 17 10:19:18 user nova-compute[73158]: </domain>
Aug 17 10:19:18 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG os_vif [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4639473-b3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4639473-b3, col_values=(('external_ids', {'iface-id': 'e4639473-b396-4d8c-aadc-30d8e10252cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:86:11', 'vm-uuid': 'a6744f73-a7ec-4388-8e15-c05068041a09'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:19:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:19 user nova-compute[73158]: INFO os_vif [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3')
Aug 17 10:19:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:19:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No VIF found with MAC fa:16:3e:c1:86:11, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:19:19 user nova-compute[73158]: DEBUG nova.network.neutron [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updated VIF entry in instance network info cache for port e4639473-b396-4d8c-aadc-30d8e10252cb. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:19:19 user nova-compute[73158]: DEBUG nova.network.neutron [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7ee99b74-fe8b-49f1-8f13-099a359d3007 req-f8ac8240-669d-43a1-b70c-6f69ee485cb4 service nova] Releasing lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-38a697da-1dc3-44be-b25c-ca6f0b22fb7b req-6a5bdf24-a9a0-4a72-9c47-afb3043627ff service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-38a697da-1dc3-44be-b25c-ca6f0b22fb7b req-6a5bdf24-a9a0-4a72-9c47-afb3043627ff service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-38a697da-1dc3-44be-b25c-ca6f0b22fb7b req-6a5bdf24-a9a0-4a72-9c47-afb3043627ff service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-38a697da-1dc3-44be-b25c-ca6f0b22fb7b req-6a5bdf24-a9a0-4a72-9c47-afb3043627ff service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-38a697da-1dc3-44be-b25c-ca6f0b22fb7b req-6a5bdf24-a9a0-4a72-9c47-afb3043627ff service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:20 user nova-compute[73158]: WARNING nova.compute.manager [req-38a697da-1dc3-44be-b25c-ca6f0b22fb7b req-6a5bdf24-a9a0-4a72-9c47-afb3043627ff service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state building and task_state spawning.
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:20 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:19:20 user nova-compute[73158]: INFO nova.compute.claims [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Claim successful on node user
Aug 17 10:19:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:19:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:19:21 user nova-compute[73158]: DEBUG nova.policy [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bfd8d8513d24d0d893689d5db089546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbba4c18d534970a667590744f891a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:19:21 user nova-compute[73158]: INFO nova.virt.block_device [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Booting with blank volume at /dev/vda
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Successfully created port: a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-e69b5bd4-5cfe-4604-bd1c-bff426d80747 req-c9c565d5-4bf9-49b6-9cf3-9e165cea3edb service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e69b5bd4-5cfe-4604-bd1c-bff426d80747 req-c9c565d5-4bf9-49b6-9cf3-9e165cea3edb service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e69b5bd4-5cfe-4604-bd1c-bff426d80747 req-c9c565d5-4bf9-49b6-9cf3-9e165cea3edb service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e69b5bd4-5cfe-4604-bd1c-bff426d80747 req-c9c565d5-4bf9-49b6-9cf3-9e165cea3edb service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-e69b5bd4-5cfe-4604-bd1c-bff426d80747 req-c9c565d5-4bf9-49b6-9cf3-9e165cea3edb service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:22 user nova-compute[73158]: WARNING nova.compute.manager [req-e69b5bd4-5cfe-4604-bd1c-bff426d80747 req-c9c565d5-4bf9-49b6-9cf3-9e165cea3edb service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state building and task_state spawning.
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267562.8649037, a6744f73-a7ec-4388-8e15-c05068041a09 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:19:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Resumed (Lifecycle Event)
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:19:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance spawned successfully.
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267562.8683248, a6744f73-a7ec-4388-8e15-c05068041a09 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:19:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Started (Lifecycle Event)
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:19:22 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:19:22 user nova-compute[73158]: INFO nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 17 10:19:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:23 user nova-compute[73158]: INFO nova.compute.manager [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Took 7.08 seconds to build instance.
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c41d0048-71eb-4c19-ba20-6bc8c6568a5d tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.180s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Successfully updated port: a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-changed-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Refreshing instance network info cache due to event network-changed-a069bad2-e308-400e-9b53-d48099e21259. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] Acquiring lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:19:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance network_info: |[{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] Acquired lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG nova.network.neutron [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Refreshing network info cache for port a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updated VIF entry in instance network info cache for port a069bad2-e308-400e-9b53-d48099e21259. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-32c04196-28c9-4f64-8ce6-32f3a6f545e3 req-c39222c4-f2a8-412d-b86f-680e36ce6634 service nova] Releasing lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG os_brick.utils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d1846-b841-457f-abff-fbc0cbac1cdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f557e2-b85d-4a8f-b5ce-0be2273fe8b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e30ddb3-0ef3-43f6-b12c-b22b945c2e09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b23df49-4517-4c5b-ad1c-a7d6557457c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:19:27 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[59891f52-0301-4092-99a4-b08ae692f216]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG os_brick.utils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating existing volume attachment record: 1ce30408-02a1-48ea-a177-d1c151ae5599 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-changed-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Refreshing instance network info cache due to event network-changed-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG nova.network.neutron [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Refreshing network info cache for port 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:19:29 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:29 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:29 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7050MB free_disk=24.38745880126953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a43f242b-fdf6-4153-acad-344d28610631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 2bf5b399-8fd5-42e4-8155-09bdf972628d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.network.neutron [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updated VIF entry in instance network info cache for port 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.network.neutron [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9abbe88b-6dea-4e6c-bf80-22629494ea23 req-695b7829-d273-4d5f-aaf0-a6dda6bf6c55 service nova] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:19:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:19:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:19:38 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Creating image(s)
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Ensure instance console log exists: /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Start _get_guest_xml network_info=[{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '1ce30408-02a1-48ea-a177-d1c151ae5599', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8fbae4f-23df-44d8-99bc-992b84cf59ee', 'attached_at': '', 'detached_at': '', 'volume_id': '21acdb4d-0337-4efe-8449-4d9c1cb82870', 'serial': '21acdb4d-0337-4efe-8449-4d9c1cb82870'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:19:38 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:38 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:19:38 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:19:38 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:19:38 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260" returned: 21 in 0.110s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d000e4db-d807-4c3b-a514-bc5c7e79ff66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:19:38 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c04811-c9a4-4b47-bb01-bb60829a5c8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870] added
Aug 17 10:19:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fb914d-da2a-4666-9654-e57087a3ba23]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[121cf2f0-5ee4-449f-a571-1e6be4abb65a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BetGArSl {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BetGArSl" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d175f214-2bf7-4221-80ff-aee84275e9e0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BetGArSl'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f233b-13bf-4794-8567-4aa7320b1428]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fcefcd-1bb4-4f39-b2d6-b97b32603e68]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:19:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:19:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b9b7eb-ac21-46ee-8775-a8c8e8f7796d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260]
Aug 17 10:19:38 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260] successful.
Aug 17 10:19:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.081s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6675df39-83d2-4628-bec3-fd0609e7bc00]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfe60c-d221-4643-b30b-a80526ae7a9f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:19:38 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:19:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:19:38 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:19:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43a7b4b-6125-4c80-9f86-9348652b4915]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:19:38 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26338396263366336', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338396263366336', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250266478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250266478',id=24,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-672w306k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:22Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f8fbae4f-23df-44d8-99bc-992b84cf59ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'pci_devices' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:19:39 user nova-compute[73158]:   <uuid>f8fbae4f-23df-44d8-99bc-992b84cf59ee</uuid>
Aug 17 10:19:39 user nova-compute[73158]:   <name>instance-00000018</name>
Aug 17 10:19:39 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:19:39 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:19:39 user nova-compute[73158]:   <metadata>
Aug 17 10:19:39 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:19:39 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:19:39 user nova-compute[73158]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1250266478</nova:name>
Aug 17 10:19:39 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:19:38</nova:creationTime>
Aug 17 10:19:39 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:19:39 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:19:39 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:19:39 user nova-compute[73158]:       <nova:owner>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:user uuid="9bfd8d8513d24d0d893689d5db089546">tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member</nova:user>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:project uuid="9bbba4c18d534970a667590744f891a2">tempest-ServerBootFromVolumeStableRescueTest-184800752</nova:project>
Aug 17 10:19:39 user nova-compute[73158]:       </nova:owner>
Aug 17 10:19:39 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:19:39 user nova-compute[73158]:       <nova:ports>
Aug 17 10:19:39 user nova-compute[73158]:         <nova:port uuid="a069bad2-e308-400e-9b53-d48099e21259">
Aug 17 10:19:39 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 10:19:39 user nova-compute[73158]:         </nova:port>
Aug 17 10:19:39 user nova-compute[73158]:       </nova:ports>
Aug 17 10:19:39 user nova-compute[73158]:     </nova:instance>
Aug 17 10:19:39 user nova-compute[73158]:   </metadata>
Aug 17 10:19:39 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:19:39 user nova-compute[73158]:     <system>
Aug 17 10:19:39 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:19:39 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:19:39 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:19:39 user nova-compute[73158]:       <entry name="serial">f8fbae4f-23df-44d8-99bc-992b84cf59ee</entry>
Aug 17 10:19:39 user nova-compute[73158]:       <entry name="uuid">f8fbae4f-23df-44d8-99bc-992b84cf59ee</entry>
Aug 17 10:19:39 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:19:39 user nova-compute[73158]:     </system>
Aug 17 10:19:39 user nova-compute[73158]:   </sysinfo>
Aug 17 10:19:39 user nova-compute[73158]:   <os>
Aug 17 10:19:39 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:19:39 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:19:39 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:19:39 user nova-compute[73158]:   </os>
Aug 17 10:19:39 user nova-compute[73158]:   <features>
Aug 17 10:19:39 user nova-compute[73158]:     <acpi/>
Aug 17 10:19:39 user nova-compute[73158]:     <apic/>
Aug 17 10:19:39 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:19:39 user nova-compute[73158]:   </features>
Aug 17 10:19:39 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:19:39 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:19:39 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:19:39 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:19:39 user nova-compute[73158]:   </clock>
Aug 17 10:19:39 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:19:39 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:19:39 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:19:39 user nova-compute[73158]:   </cpu>
Aug 17 10:19:39 user nova-compute[73158]:   <devices>
Aug 17 10:19:39 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:19:39 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:19:39 user nova-compute[73158]:       <source dev="/dev/sdc"/>
Aug 17 10:19:39 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:19:39 user nova-compute[73158]:       <serial>21acdb4d-0337-4efe-8449-4d9c1cb82870</serial>
Aug 17 10:19:39 user nova-compute[73158]:     </disk>
Aug 17 10:19:39 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:19:39 user nova-compute[73158]:       <mac address="fa:16:3e:c3:21:c9"/>
Aug 17 10:19:39 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:19:39 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:19:39 user nova-compute[73158]:       <target dev="tapa069bad2-e3"/>
Aug 17 10:19:39 user nova-compute[73158]:     </interface>
Aug 17 10:19:39 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:19:39 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/console.log" append="off"/>
Aug 17 10:19:39 user nova-compute[73158]:     </serial>
Aug 17 10:19:39 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:19:39 user nova-compute[73158]:     <video>
Aug 17 10:19:39 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:19:39 user nova-compute[73158]:     </video>
Aug 17 10:19:39 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:19:39 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:19:39 user nova-compute[73158]:     </rng>
Aug 17 10:19:39 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:19:39 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:19:39 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:19:39 user nova-compute[73158]:     </memballoon>
Aug 17 10:19:39 user nova-compute[73158]:   </devices>
Aug 17 10:19:39 user nova-compute[73158]: </domain>
Aug 17 10:19:39 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250266478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250266478',id=24,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-672w306k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:22Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f8fbae4f-23df-44d8-99bc-992b84cf59ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG os_vif [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa069bad2-e3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa069bad2-e3, col_values=(('external_ids', {'iface-id': 'a069bad2-e308-400e-9b53-d48099e21259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:21:c9', 'vm-uuid': 'f8fbae4f-23df-44d8-99bc-992b84cf59ee'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:19:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:39 user nova-compute[73158]: INFO os_vif [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3')
Aug 17 10:19:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:19:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No VIF found with MAC fa:16:3e:c3:21:c9, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-a560ba05-1b8e-4de5-9e54-0a4cc0c95680 req-c9b6fed8-2ece-4a1d-b6c1-1ec38f61ec96 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a560ba05-1b8e-4de5-9e54-0a4cc0c95680 req-c9b6fed8-2ece-4a1d-b6c1-1ec38f61ec96 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a560ba05-1b8e-4de5-9e54-0a4cc0c95680 req-c9b6fed8-2ece-4a1d-b6c1-1ec38f61ec96 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a560ba05-1b8e-4de5-9e54-0a4cc0c95680 req-c9b6fed8-2ece-4a1d-b6c1-1ec38f61ec96 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-a560ba05-1b8e-4de5-9e54-0a4cc0c95680 req-c9b6fed8-2ece-4a1d-b6c1-1ec38f61ec96 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:41 user nova-compute[73158]: WARNING nova.compute.manager [req-a560ba05-1b8e-4de5-9e54-0a4cc0c95680 req-c9b6fed8-2ece-4a1d-b6c1-1ec38f61ec96 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state building and task_state spawning.
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267583.3345935, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Resumed (Lifecycle Event)
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance spawned successfully.
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267583.336093, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Started (Lifecycle Event)
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:19:43 user nova-compute[73158]: INFO nova.compute.manager [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Took 22.59 seconds to build instance.
Aug 17 10:19:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-270c1c41-6cfd-4136-bd5f-c80b7293080e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.747s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-a8a731a3-6f34-4424-89ef-543753e8aaa6 req-5b6b80c7-a74d-4380-a1f5-16b67584c0db service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a8a731a3-6f34-4424-89ef-543753e8aaa6 req-5b6b80c7-a74d-4380-a1f5-16b67584c0db service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a8a731a3-6f34-4424-89ef-543753e8aaa6 req-5b6b80c7-a74d-4380-a1f5-16b67584c0db service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a8a731a3-6f34-4424-89ef-543753e8aaa6 req-5b6b80c7-a74d-4380-a1f5-16b67584c0db service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-a8a731a3-6f34-4424-89ef-543753e8aaa6 req-5b6b80c7-a74d-4380-a1f5-16b67584c0db service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:43 user nova-compute[73158]: WARNING nova.compute.manager [req-a8a731a3-6f34-4424-89ef-543753e8aaa6 req-5b6b80c7-a74d-4380-a1f5-16b67584c0db service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state None.
Aug 17 10:19:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:55 user nova-compute[73158]: INFO nova.compute.manager [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Terminating instance
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-064131a8-89de-49a0-98c4-1e2579000dd0 req-a73e1486-da40-4a5a-993f-45bfa83c79bb service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-unplugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-064131a8-89de-49a0-98c4-1e2579000dd0 req-a73e1486-da40-4a5a-993f-45bfa83c79bb service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-064131a8-89de-49a0-98c4-1e2579000dd0 req-a73e1486-da40-4a5a-993f-45bfa83c79bb service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-064131a8-89de-49a0-98c4-1e2579000dd0 req-a73e1486-da40-4a5a-993f-45bfa83c79bb service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-064131a8-89de-49a0-98c4-1e2579000dd0 req-a73e1486-da40-4a5a-993f-45bfa83c79bb service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-unplugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-064131a8-89de-49a0-98c4-1e2579000dd0 req-a73e1486-da40-4a5a-993f-45bfa83c79bb service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-unplugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] Instance destroyed successfully.
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.objects.instance [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lazy-loading 'resources' on Instance uuid a43f242b-fdf6-4153-acad-344d28610631 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T10:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354213922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354213922',id=17,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPvYkGOWVFK3bnMSSSTFCXkUltezm5sUPIuqsKehAaIm8xUBVADHtXN75/Ilf7Wyx6qqidaHHS4rt2ufczSBJB9kwxyO+hn0AO0hDAgiJgHb8xvnq2RboOxHW3lrIhKiA==',key_name='tempest-keypair-575233955',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb17cb60c0714fabb50a01bafaf56a6a',ramdisk_id='',reservation_id='r-mc9cu0f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1938903503',owner_user_name='tempest-TaggedAttachmentsTest-1938903503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d012173c11e42e090143411f4d9f34e',uuid=a43f242b-fdf6-4153-acad-344d28610631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converting VIF {"id": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "address": "fa:16:3e:ba:87:a1", "network": {"id": "93e839b3-3e41-4598-9e27-ea47233db624", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1259750246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb17cb60c0714fabb50a01bafaf56a6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f2143-f2", "ovs_interfaceid": "6a4f2143-f2bd-4467-a926-244b2dc8aedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG os_vif [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a4f2143-f2, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:19:55 user nova-compute[73158]: INFO os_vif [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=6a4f2143-f2bd-4467-a926-244b2dc8aedd,network=Network(93e839b3-3e41-4598-9e27-ea47233db624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f2143-f2')
Aug 17 10:19:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Deleting instance files /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631_del
Aug 17 10:19:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Deletion of /opt/stack/data/nova/instances/a43f242b-fdf6-4153-acad-344d28610631_del complete
Aug 17 10:19:55 user nova-compute[73158]: INFO nova.compute.manager [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] [instance: a43f242b-fdf6-4153-acad-344d28610631] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 10:19:55 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:19:55 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:19:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:19:56 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:56 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] Took 0.98 seconds to deallocate network for instance.
Aug 17 10:19:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-acf8e530-0d33-40e2-be05-235bf30467a6 req-ad40feb2-a0d1-43ad-ade9-c3b620082734 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-deleted-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-781749cf-da57-4761-98ed-7397555461f6 req-9f9af8d8-3db4-474c-8b45-f310a093bbb5 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received event network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-781749cf-da57-4761-98ed-7397555461f6 req-9f9af8d8-3db4-474c-8b45-f310a093bbb5 service nova] Acquiring lock "a43f242b-fdf6-4153-acad-344d28610631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-781749cf-da57-4761-98ed-7397555461f6 req-9f9af8d8-3db4-474c-8b45-f310a093bbb5 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-781749cf-da57-4761-98ed-7397555461f6 req-9f9af8d8-3db4-474c-8b45-f310a093bbb5 service nova] Lock "a43f242b-fdf6-4153-acad-344d28610631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-781749cf-da57-4761-98ed-7397555461f6 req-9f9af8d8-3db4-474c-8b45-f310a093bbb5 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] No waiting events found dispatching network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:19:57 user nova-compute[73158]: WARNING nova.compute.manager [req-781749cf-da57-4761-98ed-7397555461f6 req-9f9af8d8-3db4-474c-8b45-f310a093bbb5 service nova] [instance: a43f242b-fdf6-4153-acad-344d28610631] Received unexpected event network-vif-plugged-6a4f2143-f2bd-4467-a926-244b2dc8aedd for instance with vm_state deleted and task_state None.
Aug 17 10:19:57 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Deleted allocations for instance a43f242b-fdf6-4153-acad-344d28610631
Aug 17 10:19:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dd2e4afc-a9a4-42bc-b233-02d4bd0dd6dd tempest-TaggedAttachmentsTest-1938903503 tempest-TaggedAttachmentsTest-1938903503-project-member] Lock "a43f242b-fdf6-4153-acad-344d28610631" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-changed-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Refreshing instance network info cache due to event network-changed-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] Acquiring lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] Acquired lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Refreshing network info cache for port 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updated VIF entry in instance network info cache for port 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updating instance_info_cache with network_info: [{"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:19:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-172ed8ba-ed5e-4eab-948b-9edd59ae22ee req-fec74764-f04d-44f0-b8a3-aea7cc5bf8dd service nova] Releasing lock "refresh_cache-ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:20:01 user nova-compute[73158]: INFO nova.compute.claims [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Claim successful on node user
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:02 user nova-compute[73158]: INFO nova.compute.manager [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Attaching volume 8aa54f04-4f74-49ee-85bb-2cc5699db1dc to /dev/vdb
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG os_brick.utils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829ffbc-7c43-4788-8ee3-eada693eea0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6758aa-65cb-41a8-99f6-23abd0e7d92a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60586ee-2db1-4f48-8b74-af1846e2d07a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697268a-ce1c-4060-b5ab-ed2eeb360de4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.policy [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc72634020f043308464eca253691603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eece5be982b434daf80b44ec022192e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:20:02 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa072c7e-41ce-408e-b99b-2a9db7f447cf]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG os_brick.utils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updating existing volume attachment record: 5b5b818b-57d5-499d-a065-e6690e72c163 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:20:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Creating image(s)
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk 1073741824" returned: 0 in 0.047s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Successfully created port: 7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Cannot resize image /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'migration_context' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Ensure instance console log exists: /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Successfully updated port: 7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing instance network info cache due to event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:20:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance network_info: |[{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Start _get_guest_xml network_info=[{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:20:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:20:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-239143835',display_name='tempest-ServerRescueNegativeTestJSON-server-239143835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-239143835',id=25,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1eqcpoo3mn87FQrbz6WGDZPG9poda+eeQbUzmujx/GV+udSmpeDN+Ne6TfsLNXxAQ6hoHiCD+6DyVUw1HBdG0gsxD5Sv+mzbtxuAlIG1Fq0lnNWir8YrHr0eXfFVX5Yw==',key_name='tempest-keypair-1755267754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-jpvb3hcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc72634020f043308464eca253691603',uuid=447f35f1-f3c6-4f5e-96e7-19399846c8f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'pci_devices' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:20:04 user nova-compute[73158]:   <uuid>447f35f1-f3c6-4f5e-96e7-19399846c8f0</uuid>
Aug 17 10:20:04 user nova-compute[73158]:   <name>instance-00000019</name>
Aug 17 10:20:04 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:20:04 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:20:04 user nova-compute[73158]:   <metadata>
Aug 17 10:20:04 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:20:04 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:20:04 user nova-compute[73158]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-239143835</nova:name>
Aug 17 10:20:04 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:20:04</nova:creationTime>
Aug 17 10:20:04 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:20:04 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:20:04 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:20:04 user nova-compute[73158]:       <nova:owner>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:user uuid="fc72634020f043308464eca253691603">tempest-ServerRescueNegativeTestJSON-1859456269-project-member</nova:user>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:project uuid="0eece5be982b434daf80b44ec022192e">tempest-ServerRescueNegativeTestJSON-1859456269</nova:project>
Aug 17 10:20:04 user nova-compute[73158]:       </nova:owner>
Aug 17 10:20:04 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:20:04 user nova-compute[73158]:       <nova:ports>
Aug 17 10:20:04 user nova-compute[73158]:         <nova:port uuid="7e6a648c-93b5-4e7e-956d-ee5de80ca939">
Aug 17 10:20:04 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 10:20:04 user nova-compute[73158]:         </nova:port>
Aug 17 10:20:04 user nova-compute[73158]:       </nova:ports>
Aug 17 10:20:04 user nova-compute[73158]:     </nova:instance>
Aug 17 10:20:04 user nova-compute[73158]:   </metadata>
Aug 17 10:20:04 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:20:04 user nova-compute[73158]:     <system>
Aug 17 10:20:04 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:20:04 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:20:04 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:20:04 user nova-compute[73158]:       <entry name="serial">447f35f1-f3c6-4f5e-96e7-19399846c8f0</entry>
Aug 17 10:20:04 user nova-compute[73158]:       <entry name="uuid">447f35f1-f3c6-4f5e-96e7-19399846c8f0</entry>
Aug 17 10:20:04 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:20:04 user nova-compute[73158]:     </system>
Aug 17 10:20:04 user nova-compute[73158]:   </sysinfo>
Aug 17 10:20:04 user nova-compute[73158]:   <os>
Aug 17 10:20:04 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:20:04 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:20:04 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:20:04 user nova-compute[73158]:   </os>
Aug 17 10:20:04 user nova-compute[73158]:   <features>
Aug 17 10:20:04 user nova-compute[73158]:     <acpi/>
Aug 17 10:20:04 user nova-compute[73158]:     <apic/>
Aug 17 10:20:04 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:20:04 user nova-compute[73158]:   </features>
Aug 17 10:20:04 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:20:04 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:20:04 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:20:04 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:20:04 user nova-compute[73158]:   </clock>
Aug 17 10:20:04 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:20:04 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:20:04 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:20:04 user nova-compute[73158]:   </cpu>
Aug 17 10:20:04 user nova-compute[73158]:   <devices>
Aug 17 10:20:04 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:20:04 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:20:04 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk"/>
Aug 17 10:20:04 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:20:04 user nova-compute[73158]:     </disk>
Aug 17 10:20:04 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:20:04 user nova-compute[73158]:       <mac address="fa:16:3e:01:84:45"/>
Aug 17 10:20:04 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:20:04 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:20:04 user nova-compute[73158]:       <target dev="tap7e6a648c-93"/>
Aug 17 10:20:04 user nova-compute[73158]:     </interface>
Aug 17 10:20:04 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:20:04 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/console.log" append="off"/>
Aug 17 10:20:04 user nova-compute[73158]:     </serial>
Aug 17 10:20:04 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:20:04 user nova-compute[73158]:     <video>
Aug 17 10:20:04 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:20:04 user nova-compute[73158]:     </video>
Aug 17 10:20:04 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:20:04 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:20:04 user nova-compute[73158]:     </rng>
Aug 17 10:20:04 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:20:04 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:20:04 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:20:04 user nova-compute[73158]:     </memballoon>
Aug 17 10:20:04 user nova-compute[73158]:   </devices>
Aug 17 10:20:04 user nova-compute[73158]: </domain>
Aug 17 10:20:04 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-239143835',display_name='tempest-ServerRescueNegativeTestJSON-server-239143835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-239143835',id=25,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1eqcpoo3mn87FQrbz6WGDZPG9poda+eeQbUzmujx/GV+udSmpeDN+Ne6TfsLNXxAQ6hoHiCD+6DyVUw1HBdG0gsxD5Sv+mzbtxuAlIG1Fq0lnNWir8YrHr0eXfFVX5Yw==',key_name='tempest-keypair-1755267754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-jpvb3hcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc72634020f043308464eca253691603',uuid=447f35f1-f3c6-4f5e-96e7-19399846c8f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG os_vif [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e6a648c-93, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e6a648c-93, col_values=(('external_ids', {'iface-id': '7e6a648c-93b5-4e7e-956d-ee5de80ca939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:84:45', 'vm-uuid': '447f35f1-f3c6-4f5e-96e7-19399846c8f0'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:04 user nova-compute[73158]: INFO os_vif [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93')
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:01:84:45, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updated VIF entry in instance network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:20:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-09ff8b47-05a6-4d76-8243-9b4e7dc36270 req-ee3e8fca-c350-4597-a582-41d9d052ca00 service nova] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-a1f70963-d02f-4de7-bcc0-0b680b4c67ae req-0859f483-dea4-4d9c-a9d8-4f0dfb83828b service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a1f70963-d02f-4de7-bcc0-0b680b4c67ae req-0859f483-dea4-4d9c-a9d8-4f0dfb83828b service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a1f70963-d02f-4de7-bcc0-0b680b4c67ae req-0859f483-dea4-4d9c-a9d8-4f0dfb83828b service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a1f70963-d02f-4de7-bcc0-0b680b4c67ae req-0859f483-dea4-4d9c-a9d8-4f0dfb83828b service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-a1f70963-d02f-4de7-bcc0-0b680b4c67ae req-0859f483-dea4-4d9c-a9d8-4f0dfb83828b service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:20:06 user nova-compute[73158]: WARNING nova.compute.manager [req-a1f70963-d02f-4de7-bcc0-0b680b4c67ae req-0859f483-dea4-4d9c-a9d8-4f0dfb83828b service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state building and task_state spawning.
Aug 17 10:20:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267608.207292, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Resumed (Lifecycle Event)
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance spawned successfully.
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267608.209503, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Started (Lifecycle Event)
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-ddc5c3e9-19c4-4056-9b98-780196288ae1 req-b759a9c2-e256-4e8b-aa12-34b5a51aa490 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ddc5c3e9-19c4-4056-9b98-780196288ae1 req-b759a9c2-e256-4e8b-aa12-34b5a51aa490 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ddc5c3e9-19c4-4056-9b98-780196288ae1 req-b759a9c2-e256-4e8b-aa12-34b5a51aa490 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ddc5c3e9-19c4-4056-9b98-780196288ae1 req-b759a9c2-e256-4e8b-aa12-34b5a51aa490 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-ddc5c3e9-19c4-4056-9b98-780196288ae1 req-b759a9c2-e256-4e8b-aa12-34b5a51aa490 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:20:08 user nova-compute[73158]: WARNING nova.compute.manager [req-ddc5c3e9-19c4-4056-9b98-780196288ae1 req-b759a9c2-e256-4e8b-aa12-34b5a51aa490 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state building and task_state spawning.
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 17 10:20:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:08 user nova-compute[73158]: INFO nova.compute.manager [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Took 6.58 seconds to build instance.
Aug 17 10:20:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-88f71c4e-c5c3-4c74-8925-c457ea0965ff tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:10 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267595.8608003, a43f242b-fdf6-4153-acad-344d28610631 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:20:10 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a43f242b-fdf6-4153-acad-344d28610631] VM Stopped (Lifecycle Event)
Aug 17 10:20:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e128245b-e5b9-48b2-928e-5b7ed18086a1 None None] [instance: a43f242b-fdf6-4153-acad-344d28610631] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFQSdpAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:20:13 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:20:13 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:20:13 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdac20f-d313-48e2-b9df-a4d31871337b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:20:13 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[32629175-9b73-4c8d-a470-880f3060abf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc] added
Aug 17 10:20:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c517fbcb-a141-47f0-8979-0c17925dc648]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ad5b97-e1f5-4e12-aa5f-8bab684818e2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFQSdpAZ {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFQSdpAZ" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2e377-825a-4409-a879-4c4cf199904b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFQSdpAZ'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb876bb-ee34-4755-ab1a-0862c1f98670]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3aaf1d-deb9-4a7a-8d86-88a5cabeed12]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64620fd-ae1a-4e54-a220-a933a6c08803]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260]
Aug 17 10:20:13 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260] successful.
Aug 17 10:20:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5424d-ed3f-4f78-8ff9-0166e3c17962]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2979a67e-645e-4ede-b682-c96e00a91ccf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:20:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:20:13 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:20:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ff57e8-2595-4000-9ab1-a130090e88fc]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:20:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFQSdpAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23165633639316139', 'path': '/dev/sdd'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633639316139', 'path': '/dev/sdd'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:20:14 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:20:14 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:20:14 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:20:14 user nova-compute[73158]:   <serial>8aa54f04-4f74-49ee-85bb-2cc5699db1dc</serial>
Aug 17 10:20:14 user nova-compute[73158]: </disk>
Aug 17 10:20:14 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:20:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:85:df:1c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:20:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-426872f5-09b6-47a8-83b8-e448a5aa12e1 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.688s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:20:18 user nova-compute[73158]: INFO nova.compute.claims [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Claim successful on node user
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:20:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.policy [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1978c81194804f6cbd5e98332c36d19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14552145aeb14d838370c33104ae8374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:20:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Creating image(s)
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk 1073741824" returned: 0 in 0.055s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Successfully created port: d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Cannot resize image /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG nova.objects.instance [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'migration_context' on Instance uuid f3c36a7f-508a-4121-a6ba-a9ea65ff0699 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Ensure instance console log exists: /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Successfully updated port: d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquired lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-changed-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Refreshing instance network info cache due to event network-changed-d9b9654b-a1de-42b4-886f-05461b511f97. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] Acquiring lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Updating instance_info_cache with network_info: [{"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Releasing lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Instance network_info: |[{"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] Acquired lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.network.neutron [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Refreshing network info cache for port d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:20:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Start _get_guest_xml network_info=[{"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:20:20 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:20:20 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-267412422',display_name='tempest-AttachVolumeNegativeTest-server-267412422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-267412422',id=26,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+BYxPQL7oP6XJBFlUdYQcfcLytmH3nGvNyExMfeNFD882TIcLngBmAjAMLoKgISBqIkj7lllvJK8KgyVNV0ABMGgbfAP+bbiIs2+4Pmqf4sZg7UgXrK0X2jdeyWKXc9w==',key_name='tempest-keypair-103050085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-lf1uuzf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=f3c36a7f-508a-4121-a6ba-a9ea65ff0699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c36a7f-508a-4121-a6ba-a9ea65ff0699 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:20:21 user nova-compute[73158]:   <uuid>f3c36a7f-508a-4121-a6ba-a9ea65ff0699</uuid>
Aug 17 10:20:21 user nova-compute[73158]:   <name>instance-0000001a</name>
Aug 17 10:20:21 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:20:21 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:20:21 user nova-compute[73158]:   <metadata>
Aug 17 10:20:21 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:20:21 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:20:21 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeNegativeTest-server-267412422</nova:name>
Aug 17 10:20:21 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:20:20</nova:creationTime>
Aug 17 10:20:21 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:20:21 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:20:21 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:20:21 user nova-compute[73158]:       <nova:owner>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:user uuid="1978c81194804f6cbd5e98332c36d19d">tempest-AttachVolumeNegativeTest-1781394635-project-member</nova:user>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:project uuid="14552145aeb14d838370c33104ae8374">tempest-AttachVolumeNegativeTest-1781394635</nova:project>
Aug 17 10:20:21 user nova-compute[73158]:       </nova:owner>
Aug 17 10:20:21 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:20:21 user nova-compute[73158]:       <nova:ports>
Aug 17 10:20:21 user nova-compute[73158]:         <nova:port uuid="d9b9654b-a1de-42b4-886f-05461b511f97">
Aug 17 10:20:21 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 10:20:21 user nova-compute[73158]:         </nova:port>
Aug 17 10:20:21 user nova-compute[73158]:       </nova:ports>
Aug 17 10:20:21 user nova-compute[73158]:     </nova:instance>
Aug 17 10:20:21 user nova-compute[73158]:   </metadata>
Aug 17 10:20:21 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:20:21 user nova-compute[73158]:     <system>
Aug 17 10:20:21 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:20:21 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:20:21 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:20:21 user nova-compute[73158]:       <entry name="serial">f3c36a7f-508a-4121-a6ba-a9ea65ff0699</entry>
Aug 17 10:20:21 user nova-compute[73158]:       <entry name="uuid">f3c36a7f-508a-4121-a6ba-a9ea65ff0699</entry>
Aug 17 10:20:21 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:20:21 user nova-compute[73158]:     </system>
Aug 17 10:20:21 user nova-compute[73158]:   </sysinfo>
Aug 17 10:20:21 user nova-compute[73158]:   <os>
Aug 17 10:20:21 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:20:21 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:20:21 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:20:21 user nova-compute[73158]:   </os>
Aug 17 10:20:21 user nova-compute[73158]:   <features>
Aug 17 10:20:21 user nova-compute[73158]:     <acpi/>
Aug 17 10:20:21 user nova-compute[73158]:     <apic/>
Aug 17 10:20:21 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:20:21 user nova-compute[73158]:   </features>
Aug 17 10:20:21 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:20:21 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:20:21 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:20:21 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:20:21 user nova-compute[73158]:   </clock>
Aug 17 10:20:21 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:20:21 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:20:21 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:20:21 user nova-compute[73158]:   </cpu>
Aug 17 10:20:21 user nova-compute[73158]:   <devices>
Aug 17 10:20:21 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:20:21 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:20:21 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk"/>
Aug 17 10:20:21 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:20:21 user nova-compute[73158]:     </disk>
Aug 17 10:20:21 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:20:21 user nova-compute[73158]:       <mac address="fa:16:3e:11:0f:e7"/>
Aug 17 10:20:21 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:20:21 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:20:21 user nova-compute[73158]:       <target dev="tapd9b9654b-a1"/>
Aug 17 10:20:21 user nova-compute[73158]:     </interface>
Aug 17 10:20:21 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:20:21 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/console.log" append="off"/>
Aug 17 10:20:21 user nova-compute[73158]:     </serial>
Aug 17 10:20:21 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:20:21 user nova-compute[73158]:     <video>
Aug 17 10:20:21 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:20:21 user nova-compute[73158]:     </video>
Aug 17 10:20:21 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:20:21 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:20:21 user nova-compute[73158]:     </rng>
Aug 17 10:20:21 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:20:21 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:20:21 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:20:21 user nova-compute[73158]:     </memballoon>
Aug 17 10:20:21 user nova-compute[73158]:   </devices>
Aug 17 10:20:21 user nova-compute[73158]: </domain>
Aug 17 10:20:21 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-267412422',display_name='tempest-AttachVolumeNegativeTest-server-267412422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-267412422',id=26,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+BYxPQL7oP6XJBFlUdYQcfcLytmH3nGvNyExMfeNFD882TIcLngBmAjAMLoKgISBqIkj7lllvJK8KgyVNV0ABMGgbfAP+bbiIs2+4Pmqf4sZg7UgXrK0X2jdeyWKXc9w==',key_name='tempest-keypair-103050085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-lf1uuzf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=f3c36a7f-508a-4121-a6ba-a9ea65ff0699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_vif [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9b9654b-a1, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9b9654b-a1, col_values=(('external_ids', {'iface-id': 'd9b9654b-a1de-42b4-886f-05461b511f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:0f:e7', 'vm-uuid': 'f3c36a7f-508a-4121-a6ba-a9ea65ff0699'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:21 user nova-compute[73158]: INFO nova.compute.manager [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Detaching volume e842274a-20aa-4430-8a31-deb0ae81cc56
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:21 user nova-compute[73158]: INFO os_vif [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1')
Aug 17 10:20:21 user nova-compute[73158]: INFO nova.virt.block_device [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Attempting to driver detach volume e842274a-20aa-4430-8a31-deb0ae81cc56 from mountpoint /dev/vdb
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Attempting to detach device vdb from instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:20:21 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:20:21 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:20:21 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:20:21 user nova-compute[73158]:   <serial>e842274a-20aa-4430-8a31-deb0ae81cc56</serial>
Aug 17 10:20:21 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:20:21 user nova-compute[73158]: </disk>
Aug 17 10:20:21 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:11:0f:e7, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:20:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully detached device vdb from instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f from the persistent domain config.
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:20:21 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:20:21 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:20:21 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:20:21 user nova-compute[73158]:   <serial>e842274a-20aa-4430-8a31-deb0ae81cc56</serial>
Aug 17 10:20:21 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:20:21 user nova-compute[73158]: </disk>
Aug 17 10:20:21 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.network.neutron [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Updated VIF entry in instance network info cache for port d9b9654b-a1de-42b4-886f-05461b511f97. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.network.neutron [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Updating instance_info_cache with network_info: [{"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b19e1ea6-674f-4c6d-8797-13da5d3b83f7 req-205759ae-2865-46e1-8a21-9d2a4338a052 service nova] Releasing lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267621.80542, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:20:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully detached device vdb from instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f from the live domain config.
Aug 17 10:20:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHTDUYmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:20:21 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b3748-1cbe-43dc-ad85-12b3b3037b6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60bd0e-d670-4856-ad42-f8fc461ab62f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:20:21 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:20:21 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:20:21 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 (non-flash)
Aug 17 10:20:21 user nova-compute[73158]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:20:21 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:20:21 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc7e04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6167e86-5766-4469-9bcc-de7a990f0330]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d425e392-a61d-4b80-9c4b-1a71293b451f]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd057b-17b9-4e8a-be11-e86f60fc9d41]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[21035ca8-137b-4876-8453-0bb210b176c1]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:20:21 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d61b1a-b127-434a-8482-04b0520b2751]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dd1a26-847f-4fbf-8381-fca94eabb6a9]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260]
Aug 17 10:20:22 user nova-compute[73158]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56, portal: 172.16.0.220,3260] successful.
Aug 17 10:20:22 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e842274a-20aa-4430-8a31-deb0ae81cc56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[330aca6f-ccec-40af-bec5-e21e683097d7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== disconnect_volume: return (286ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:22 user nova-compute[73158]: DEBUG nova.objects.instance [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'flavor' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-11abd20b-d021-4c44-b2db-a41fdaaf9304 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.983s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-c7c09493-1ee1-4ee6-8b70-376e16b9f5a2 req-288e4963-3c1c-41aa-a6c8-5d55f9da7fa2 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c7c09493-1ee1-4ee6-8b70-376e16b9f5a2 req-288e4963-3c1c-41aa-a6c8-5d55f9da7fa2 service nova] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c7c09493-1ee1-4ee6-8b70-376e16b9f5a2 req-288e4963-3c1c-41aa-a6c8-5d55f9da7fa2 service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c7c09493-1ee1-4ee6-8b70-376e16b9f5a2 req-288e4963-3c1c-41aa-a6c8-5d55f9da7fa2 service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-c7c09493-1ee1-4ee6-8b70-376e16b9f5a2 req-288e4963-3c1c-41aa-a6c8-5d55f9da7fa2 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] No waiting events found dispatching network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:20:23 user nova-compute[73158]: WARNING nova.compute.manager [req-c7c09493-1ee1-4ee6-8b70-376e16b9f5a2 req-288e4963-3c1c-41aa-a6c8-5d55f9da7fa2 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received unexpected event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 for instance with vm_state building and task_state spawning.
Aug 17 10:20:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating instance_info_cache with network_info: [{"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267624.9778073, f3c36a7f-508a-4121-a6ba-a9ea65ff0699 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:20:24 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] VM Resumed (Lifecycle Event)
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:20:24 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Instance spawned successfully.
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:20:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:20:25 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267624.978911, f3c36a7f-508a-4121-a6ba-a9ea65ff0699 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:20:25 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] VM Started (Lifecycle Event)
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:20:25 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:20:25 user nova-compute[73158]: INFO nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-28b90d44-e8a3-4102-9f0a-9df229508214 req-1687cf18-9438-4b31-a9e1-5599bb4be20b service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-28b90d44-e8a3-4102-9f0a-9df229508214 req-1687cf18-9438-4b31-a9e1-5599bb4be20b service nova] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-28b90d44-e8a3-4102-9f0a-9df229508214 req-1687cf18-9438-4b31-a9e1-5599bb4be20b service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-28b90d44-e8a3-4102-9f0a-9df229508214 req-1687cf18-9438-4b31-a9e1-5599bb4be20b service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-28b90d44-e8a3-4102-9f0a-9df229508214 req-1687cf18-9438-4b31-a9e1-5599bb4be20b service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] No waiting events found dispatching network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:20:25 user nova-compute[73158]: WARNING nova.compute.manager [req-28b90d44-e8a3-4102-9f0a-9df229508214 req-1687cf18-9438-4b31-a9e1-5599bb4be20b service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received unexpected event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 for instance with vm_state building and task_state spawning.
Aug 17 10:20:25 user nova-compute[73158]: INFO nova.compute.manager [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Took 7.29 seconds to build instance.
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-268c239e-0e37-4204-83b2-18662ca72f6d tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.435s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:27 user nova-compute[73158]: INFO nova.compute.manager [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Terminating instance
Aug 17 10:20:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-93294ad9-806c-495b-a5a4-0d51cdc6d614 req-a5e6a553-29a5-436c-8f3a-35f73976d0e3 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-vif-unplugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-93294ad9-806c-495b-a5a4-0d51cdc6d614 req-a5e6a553-29a5-436c-8f3a-35f73976d0e3 service nova] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-93294ad9-806c-495b-a5a4-0d51cdc6d614 req-a5e6a553-29a5-436c-8f3a-35f73976d0e3 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-93294ad9-806c-495b-a5a4-0d51cdc6d614 req-a5e6a553-29a5-436c-8f3a-35f73976d0e3 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-93294ad9-806c-495b-a5a4-0d51cdc6d614 req-a5e6a553-29a5-436c-8f3a-35f73976d0e3 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] No waiting events found dispatching network-vif-unplugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-93294ad9-806c-495b-a5a4-0d51cdc6d614 req-a5e6a553-29a5-436c-8f3a-35f73976d0e3 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-vif-unplugged-55618661-f6be-4231-b549-1fd23e216e7a for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Instance destroyed successfully.
Aug 17 10:20:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lazy-loading 'resources' on Instance uuid 2bf5b399-8fd5-42e4-8155-09bdf972628d {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-922737175',display_name='tempest-VolumesActionsTest-instance-922737175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-922737175',id=21,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:18:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07223795d5094ee1b75158a794497264',ramdisk_id='',reservation_id='r-9pvscdrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1130727858',owner_user_name='tempest-VolumesActionsTest-1130727858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:18:44Z,user_data=None,user_id='cbecf64518ba437895e7816c5ad54b9d',uuid=2bf5b399-8fd5-42e4-8155-09bdf972628d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converting VIF {"id": "55618661-f6be-4231-b549-1fd23e216e7a", "address": "fa:16:3e:48:56:13", "network": {"id": "22d4c488-b1ed-4846-a193-14fa25e885cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-874001908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07223795d5094ee1b75158a794497264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55618661-f6", "ovs_interfaceid": "55618661-f6be-4231-b549-1fd23e216e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG os_vif [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55618661-f6, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:20:28 user nova-compute[73158]: INFO os_vif [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:56:13,bridge_name='br-int',has_traffic_filtering=True,id=55618661-f6be-4231-b549-1fd23e216e7a,network=Network(22d4c488-b1ed-4846-a193-14fa25e885cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55618661-f6')
Aug 17 10:20:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Deleting instance files /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d_del
Aug 17 10:20:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Deletion of /opt/stack/data/nova/instances/2bf5b399-8fd5-42e4-8155-09bdf972628d_del complete
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:28 user nova-compute[73158]: INFO nova.compute.manager [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-579597e1-01b7-43a3-8c84-ca5081a78a89 req-1a443605-d4e3-43e2-bcc3-c2e19b2bdbef service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-vif-deleted-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:29 user nova-compute[73158]: INFO nova.compute.manager [req-579597e1-01b7-43a3-8c84-ca5081a78a89 req-1a443605-d4e3-43e2-bcc3-c2e19b2bdbef service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Neutron deleted interface 55618661-f6be-4231-b549-1fd23e216e7a; detaching it from the instance and deleting it from the info cache
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.network.neutron [req-579597e1-01b7-43a3-8c84-ca5081a78a89 req-1a443605-d4e3-43e2-bcc3-c2e19b2bdbef service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:29 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Took 0.83 seconds to deallocate network for instance.
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-579597e1-01b7-43a3-8c84-ca5081a78a89 req-1a443605-d4e3-43e2-bcc3-c2e19b2bdbef service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Detach interface failed, port_id=55618661-f6be-4231-b549-1fd23e216e7a, reason: Instance 2bf5b399-8fd5-42e4-8155-09bdf972628d could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:20:29 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-8931ad25-8087-4bb3-bdcd-8cf8be0169c6 req-f9fdfdac-993b-4518-8590-ba7a20fb33c8 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received event network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8931ad25-8087-4bb3-bdcd-8cf8be0169c6 req-f9fdfdac-993b-4518-8590-ba7a20fb33c8 service nova] Acquiring lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8931ad25-8087-4bb3-bdcd-8cf8be0169c6 req-f9fdfdac-993b-4518-8590-ba7a20fb33c8 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8931ad25-8087-4bb3-bdcd-8cf8be0169c6 req-f9fdfdac-993b-4518-8590-ba7a20fb33c8 service nova] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-8931ad25-8087-4bb3-bdcd-8cf8be0169c6 req-f9fdfdac-993b-4518-8590-ba7a20fb33c8 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] No waiting events found dispatching network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:20:30 user nova-compute[73158]: WARNING nova.compute.manager [req-8931ad25-8087-4bb3-bdcd-8cf8be0169c6 req-f9fdfdac-993b-4518-8590-ba7a20fb33c8 service nova] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Received unexpected event network-vif-plugged-55618661-f6be-4231-b549-1fd23e216e7a for instance with vm_state deleted and task_state None.
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:30 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Deleted allocations for instance 2bf5b399-8fd5-42e4-8155-09bdf972628d
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d122fa4e-8a4f-458d-b278-c504abfe55c2 tempest-VolumesActionsTest-1130727858 tempest-VolumesActionsTest-1130727858-project-member] Lock "2bf5b399-8fd5-42e4-8155-09bdf972628d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.593s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:20:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=6899MB free_disk=24.329326629638672GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f3c36a7f-508a-4121-a6ba-a9ea65ff0699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:20:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:20:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:43 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267628.392541, 2bf5b399-8fd5-42e4-8155-09bdf972628d => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:20:43 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] VM Stopped (Lifecycle Event)
Aug 17 10:20:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7ad62756-4371-4c21-b3d8-6605d6d467f9 None None] [instance: 2bf5b399-8fd5-42e4-8155-09bdf972628d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:20:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-changed-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Refreshing instance network info cache due to event network-changed-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] Acquiring lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] Acquired lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Refreshing network info cache for port e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'flavor' on Instance uuid d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updated VIF entry in instance network info cache for port e7e169e7-a1ff-486a-b2f5-ef7ef823dd64. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updating instance_info_cache with network_info: [{"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-affc8d83-6082-4ecf-8067-505b03569b32 req-2e785dce-1478-4817-8aa7-51e5a17a9d40 service nova] Releasing lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:20:54 user nova-compute[73158]: INFO nova.compute.manager [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Attaching volume ec8bb083-9c24-4cec-9581-ce7b5f6c1579 to /dev/vdb
Aug 17 10:20:54 user nova-compute[73158]: DEBUG os_brick.utils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[96707bd0-8f2d-4296-8b01-e0eb49b52749]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f494e93-9d43-4adf-b499-a3cc0f6d4b64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4941bfb-aad4-4072-a933-a48dd0ed94e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8dade-f7e7-487d-8757-65eaeef431c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:20:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:20:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:20:55 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:20:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525e97b-efdd-4884-8227-41734bd6b67a]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:20:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:20:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:20:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:20:55 user nova-compute[73158]: DEBUG os_brick.utils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:20:55 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updating existing volume attachment record: 62707af7-16e1-4509-b96c-8f43b023ad86 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:20:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:20:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'flavor' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:02 user nova-compute[73158]: INFO nova.compute.manager [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Attaching volume 46720a89-362f-4ba1-b1f1-ec2c198aa525 to /dev/vdb
Aug 17 10:21:02 user nova-compute[73158]: DEBUG os_brick.utils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0310b1-7cfa-4041-8b4e-fe83c0d96b5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9330839-5e4d-4460-aae5-cede008ca722]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[149380c2-5e07-42e4-939b-c7c0990eba9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197a57b-1455-42ab-878a-333d61fd5ff4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:02 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:21:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f616fd-41b8-4b10-b52b-5738815b10e9]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG os_brick.utils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:02 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating existing volume attachment record: 1310603c-da1a-487d-8b75-98e26361f875 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:21:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfzPCIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:05 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[30564dd3-a142-4707-9bed-55ca5549a673]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:21:05 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e69d133-6765-4484-abd1-70852522d8a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579] added
Aug 17 10:21:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e4253-4392-469a-92aa-49336ab74a7b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[95381cc5-bd06-4f41-b8b2-7e43c61cf5dd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfzPCIwT {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfzPCIwT" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b04a512-f6d8-49c3-81ec-95af03b6c07d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mfzPCIwT'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7ca357-ac1d-4dca-827e-35c98ee3148e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[361782d1-aeb7-42b2-af5b-0dee4d14408e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:06 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:06 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aabebf-15ed-4cb7-8554-c48c22ed27e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260]
Aug 17 10:21:06 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260] successful.
Aug 17 10:21:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c40cd9-1e20-46e7-b1cb-db0c44494ffd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf32578f-a62d-4c45-a60d-74ee7acb0edc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:06 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:06 user nova-compute[73158]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 (non-flash)
Aug 17 10:21:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:06 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:06 user nova-compute[73158]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 (non-flash)
Aug 17 10:21:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c07f9-69b2-4486-83be-842fe8709fd1]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-changed-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Refreshing instance network info cache due to event network-changed-e4639473-b396-4d8c-aadc-30d8e10252cb. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] Acquiring lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] Acquired lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Refreshing network info cache for port e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfzPCIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23863626631333564', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863626631333564', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'flavor' on Instance uuid d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:21:07 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:07 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:21:07 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:21:07 user nova-compute[73158]:   <serial>ec8bb083-9c24-4cec-9581-ce7b5f6c1579</serial>
Aug 17 10:21:07 user nova-compute[73158]: </disk>
Aug 17 10:21:07 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No VIF found with MAC fa:16:3e:34:7d:53, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0f0eec8e-f1ac-4174-8314-be12909a4624 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.972s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updated VIF entry in instance network info cache for port e4639473-b396-4d8c-aadc-30d8e10252cb. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-77332a2f-b9e5-4ed2-80de-1747bf76212b req-74c02c57-f1b0-4380-940f-2a7c3d76069a service nova] Releasing lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:21:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:10 user nova-compute[73158]: INFO nova.compute.manager [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Detaching volume ec8bb083-9c24-4cec-9581-ce7b5f6c1579
Aug 17 10:21:10 user nova-compute[73158]: INFO nova.virt.block_device [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Attempting to driver detach volume ec8bb083-9c24-4cec-9581-ce7b5f6c1579 from mountpoint /dev/vdb
Aug 17 10:21:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Attempting to detach device vdb from instance d2dbefd6-afaf-4446-977f-69c0ead85a01 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:21:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:21:10 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:10 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:21:10 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:21:10 user nova-compute[73158]:   <serial>ec8bb083-9c24-4cec-9581-ce7b5f6c1579</serial>
Aug 17 10:21:10 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:21:10 user nova-compute[73158]: </disk>
Aug 17 10:21:10 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:21:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully detached device vdb from instance d2dbefd6-afaf-4446-977f-69c0ead85a01 from the persistent domain config.
Aug 17 10:21:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2dbefd6-afaf-4446-977f-69c0ead85a01 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:21:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:21:10 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:10 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:21:10 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:21:10 user nova-compute[73158]:   <serial>ec8bb083-9c24-4cec-9581-ce7b5f6c1579</serial>
Aug 17 10:21:10 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:21:10 user nova-compute[73158]: </disk>
Aug 17 10:21:10 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267671.227794, d2dbefd6-afaf-4446-977f-69c0ead85a01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:21:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully detached device vdb from instance d2dbefd6-afaf-4446-977f-69c0ead85a01 from the live domain config.
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfzPCIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:11 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d177e-c741-4b6e-a05e-33a654335074]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[05018c51-c66b-472d-8180-95d91de72c8e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:11 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:11 user nova-compute[73158]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 (non-flash)
Aug 17 10:21:11 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:11 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:11 user nova-compute[73158]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 (non-flash)
Aug 17 10:21:11 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc34261cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ff3a9-e3b9-4c26-9788-9f959769180f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1dd5d9-8609-4fb8-a78c-eafc94672986]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bfb1d5-8c12-46a3-baff-49c6416bc2e7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b9a8f-be04-4367-89b5-6d283b109533]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:11 user nova-compute[73158]: INFO nova.compute.manager [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Terminating instance
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94bce2d-ce1a-4398-b16a-510e61621044]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c964b87-6333-43a5-81b9-6fad5ca80830]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260]
Aug 17 10:21:11 user nova-compute[73158]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579, portal: 172.16.0.220,3260] successful.
Aug 17 10:21:11 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8bb083-9c24-4cec-9581-ce7b5f6c1579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c5ba89-36c3-4258-bdc7-849587788fd6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] <== disconnect_volume: return (306ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:11 user nova-compute[73158]: INFO nova.compute.manager [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Rescuing
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-557a190b-53e0-472b-9cb9-0c00ec93939d req-7706eb41-6a83-4a60-9f74-16fb53a686d4 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-unplugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-557a190b-53e0-472b-9cb9-0c00ec93939d req-7706eb41-6a83-4a60-9f74-16fb53a686d4 service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-557a190b-53e0-472b-9cb9-0c00ec93939d req-7706eb41-6a83-4a60-9f74-16fb53a686d4 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-557a190b-53e0-472b-9cb9-0c00ec93939d req-7706eb41-6a83-4a60-9f74-16fb53a686d4 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-557a190b-53e0-472b-9cb9-0c00ec93939d req-7706eb41-6a83-4a60-9f74-16fb53a686d4 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-unplugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-557a190b-53e0-472b-9cb9-0c00ec93939d req-7706eb41-6a83-4a60-9f74-16fb53a686d4 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-unplugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Instance destroyed successfully.
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.objects.instance [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'resources' on Instance uuid d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1073118539',display_name='tempest-ServerActionsTestOtherA-server-899659922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1073118539',id=13,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG4LLkTmKho7/DQkyMNHGblsl70hzP8HYWZF20OVinvBCArgUJTLIzfiZocc2B8phKSY8gneCeCgsuHYXDlUAabL2CpzyN29TsJEHurUvK+CymBK24Ui19oF18ADrR4nw==',key_name='tempest-keypair-1229036182',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-edr8e3uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "7be9163a-0c94-4891-8449-84d9a81abf29", "address": "fa:16:3e:f5:c3:be", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9163a-0c", "ovs_interfaceid": "7be9163a-0c94-4891-8449-84d9a81abf29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG os_vif [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be9163a-0c, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:21:12 user nova-compute[73158]: INFO os_vif [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=7be9163a-0c94-4891-8449-84d9a81abf29,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9163a-0c')
Aug 17 10:21:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Deleting instance files /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f_del
Aug 17 10:21:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Deletion of /opt/stack/data/nova/instances/d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f_del complete
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'flavor' on Instance uuid d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:12 user nova-compute[73158]: INFO nova.compute.manager [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 17 10:21:12 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2766857e-cc02-4276-a5a3-0e4e14f8b199 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.793s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance destroyed successfully.
Aug 17 10:21:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Attempting a stable device rescue
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73158) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:21:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Creating image(s)
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "7594c541bdd841af102165e7b3a66b86450d1503" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "7594c541bdd841af102165e7b3a66b86450d1503" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:13 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Took 0.95 seconds to deallocate network for instance.
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-2c939c2a-e676-43d2-a97c-a653a05d8237 req-c8398fbd-57ae-4f4e-a7e8-2fdec0746c5b service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-deleted-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:13 user nova-compute[73158]: INFO nova.compute.manager [req-2c939c2a-e676-43d2-a97c-a653a05d8237 req-c8398fbd-57ae-4f4e-a7e8-2fdec0746c5b service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Neutron deleted interface 7be9163a-0c94-4891-8449-84d9a81abf29; detaching it from the instance and deleting it from the info cache
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-2c939c2a-e676-43d2-a97c-a653a05d8237 req-c8398fbd-57ae-4f4e-a7e8-2fdec0746c5b service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-2c939c2a-e676-43d2-a97c-a653a05d8237 req-c8398fbd-57ae-4f4e-a7e8-2fdec0746c5b service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Detach interface failed, port_id=7be9163a-0c94-4891-8449-84d9a81abf29, reason: Instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Acquiring lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] No waiting events found dispatching network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:14 user nova-compute[73158]: WARNING nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Received unexpected event network-vif-plugged-7be9163a-0c94-4891-8449-84d9a81abf29 for instance with vm_state deleted and task_state None.
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:14 user nova-compute[73158]: WARNING nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:14 user nova-compute[73158]: WARNING nova.compute.manager [req-383e99a6-5aaf-42e9-b633-e1a9289bdcaf req-08ce1b15-ab01-401b-8f04-00c6e8f14334 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.virt.images [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ff65aa22-a753-4072-b1eb-da90f25fb4d2 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.part /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.part /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.converted" returned: 0 in 0.162s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "7594c541bdd841af102165e7b3a66b86450d1503" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.401s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "7594c541bdd841af102165e7b3a66b86450d1503" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "7594c541bdd841af102165e7b3a66b86450d1503" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.437s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:14 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Deleted allocations for instance d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503 --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503,backing_fmt=raw /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503,backing_fmt=raw /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue" returned: 0 in 0.059s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "7594c541bdd841af102165e7b3a66b86450d1503" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'migration_context' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-91c0d097-b38c-4ee3-b51a-85537ff6e578 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.606s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Start _get_guest_xml network_info=[{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "vif_mac": "fa:16:3e:c3:21:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff65aa22-a753-4072-b1eb-da90f25fb4d2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '1ce30408-02a1-48ea-a177-d1c151ae5599', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f8fbae4f-23df-44d8-99bc-992b84cf59ee', 'attached_at': '', 'detached_at': '', 'volume_id': '21acdb4d-0337-4efe-8449-4d9c1cb82870', 'serial': '21acdb4d-0337-4efe-8449-4d9c1cb82870'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'resources' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'numa_topology' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:21:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:15 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:15 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:15 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b74a09-c911-4ba8-993d-8b928368d611]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BetGArSl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 10:21:15 user nova-compute[73158]: node.name = iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870
Aug 17 10:21:15 user nova-compute[73158]: node.tpgt = -1
Aug 17 10:21:15 user nova-compute[73158]: node.startup = automatic
Aug 17 10:21:15 user nova-compute[73158]: node.leading_login = No
Aug 17 10:21:15 user nova-compute[73158]: iface.iscsi_ifacename = default
Aug 17 10:21:15 user nova-compute[73158]: iface.net_ifacename = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.ipaddress = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.prefix_len = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.hwaddress = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.transport_name = tcp
Aug 17 10:21:15 user nova-compute[73158]: iface.initiatorname = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.vlan_id = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.vlan_priority = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.vlan_state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.iface_num = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.mtu = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.port = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.bootproto = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.subnet_mask = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.gateway = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_alt_client_id = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_dns = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_learn_iqn = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_vendor_id_state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_vendor_id = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.dhcp_slp_da = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.fragmentation = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.gratuitous_arp = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.incoming_forwarding = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.tos_state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.tos = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.ttl = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.delayed_ack = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.tcp_nagle = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.tcp_wsf_state = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.tcp_wsf = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.tcp_timer_scale = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.tcp_timestamp = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.redirect = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.def_task_mgmt_timeout = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.header_digest = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.data_digest = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.immediate_data = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.initial_r2t = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.data_seq_inorder = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.data_pdu_inorder = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.erl = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.max_receive_data_len = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.first_burst_len = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.max_outstanding_r2t = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.max_burst_len = 0
Aug 17 10:21:15 user nova-compute[73158]: iface.chap_auth = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.bidi_chap = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.strict_login_compliance = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.discovery_auth = <empty>
Aug 17 10:21:15 user nova-compute[73158]: iface.discovery_logout = <empty>
Aug 17 10:21:15 user nova-compute[73158]: node.discovery_address = <empty>
Aug 17 10:21:15 user nova-compute[73158]: node.discovery_port = 0
Aug 17 10:21:15 user nova-compute[73158]: node.discovery_type = static
Aug 17 10:21:15 user nova-compute[73158]: node.session.initial_cmdsn = 0
Aug 17 10:21:15 user nova-compute[73158]: node.session.initial_login_retry_max = 8
Aug 17 10:21:15 user nova-compute[73158]: node.session.xmit_thread_priority = -20
Aug 17 10:21:15 user nova-compute[73158]: node.session.cmds_max = 128
Aug 17 10:21:15 user nova-compute[73158]: node.session.queue_depth = 32
Aug 17 10:21:15 user nova-compute[73158]: node.session.nr_sessions = 1
Aug 17 10:21:15 user nova-compute[73158]: node.session.auth.authmethod = CHAP
Aug 17 10:21:15 user nova-compute[73158]: node.session.auth.username = BetGArSl
Aug 17 10:21:15 user nova-compute[73158]: node.session.auth.password = ***
Aug 17 10:21:15 user nova-compute[73158]: node.session.auth.username_in = <empty>
Aug 17 10:21:15 user nova-compute[73158]: node.session.auth.password_in = <empty>
Aug 17 10:21:15 user nova-compute[73158]: node.session.auth.chap_algs = MD5
Aug 17 10:21:15 user nova-compute[73158]: node.session.timeo.replacement_timeout = 120
Aug 17 10:21:15 user nova-compute[73158]: node.session.err_timeo.abort_timeout = 15
Aug 17 10:21:15 user nova-compute[73158]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 10:21:15 user nova-compute[73158]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 10:21:15 user nova-compute[73158]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.FastAbort = Yes
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.InitialR2T = No
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.ImmediateData = Yes
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.MaxConnections = 1
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 10:21:15 user nova-compute[73158]: node.session.iscsi.ERL = 0
Aug 17 10:21:15 user nova-compute[73158]: node.session.scan = manual
Aug 17 10:21:15 user nova-compute[73158]: node.session.reopen_max = 0
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].address = 172.16.0.220
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].port = 3260
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].startup = manual
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].tcp.window_size = 524288
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].tcp.type_of_service = 0
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].timeo.logout_timeout = 15
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].timeo.login_timeout = 15
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].timeo.auth_timeout = 45
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].iscsi.DataDigest = None
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].iscsi.IFMarker = No
Aug 17 10:21:15 user nova-compute[73158]: node.conn[0].iscsi.OFMarker = No
Aug 17 10:21:15 user nova-compute[73158]: # END RECORD
Aug 17 10:21:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e5ea6-3e95-4be6-85c6-2a8090c43b3f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db282f-7fcc-42f6-8ef9-36d0a9130721]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BetGArSl {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BetGArSl" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f56140a-5ebd-41e8-b892-09a12931f841]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BetGArSl'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75eaf74-bc16-4777-a5ce-f945275cf041]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f0baa7-00f1-4f8c-bb76-08413dad9b59]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:15 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:15 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[214d65aa-95aa-4c26-ba4e-cf561ce086dc]: (4, ('0 0 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '26338396263366336', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338396263366336', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250266478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250266478',id=24,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-672w306k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:43Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f8fbae4f-23df-44d8-99bc-992b84cf59ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "vif_mac": "fa:16:3e:c3:21:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "vif_mac": "fa:16:3e:c3:21:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'pci_devices' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:21:15 user nova-compute[73158]:   <uuid>f8fbae4f-23df-44d8-99bc-992b84cf59ee</uuid>
Aug 17 10:21:15 user nova-compute[73158]:   <name>instance-00000018</name>
Aug 17 10:21:15 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:21:15 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:21:15 user nova-compute[73158]:   <metadata>
Aug 17 10:21:15 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:21:15 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:21:15 user nova-compute[73158]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1250266478</nova:name>
Aug 17 10:21:15 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:21:15</nova:creationTime>
Aug 17 10:21:15 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:21:15 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:21:15 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:21:15 user nova-compute[73158]:       <nova:owner>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:user uuid="9bfd8d8513d24d0d893689d5db089546">tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member</nova:user>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:project uuid="9bbba4c18d534970a667590744f891a2">tempest-ServerBootFromVolumeStableRescueTest-184800752</nova:project>
Aug 17 10:21:15 user nova-compute[73158]:       </nova:owner>
Aug 17 10:21:15 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:21:15 user nova-compute[73158]:       <nova:ports>
Aug 17 10:21:15 user nova-compute[73158]:         <nova:port uuid="a069bad2-e308-400e-9b53-d48099e21259">
Aug 17 10:21:15 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 10:21:15 user nova-compute[73158]:         </nova:port>
Aug 17 10:21:15 user nova-compute[73158]:       </nova:ports>
Aug 17 10:21:15 user nova-compute[73158]:     </nova:instance>
Aug 17 10:21:15 user nova-compute[73158]:   </metadata>
Aug 17 10:21:15 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:21:15 user nova-compute[73158]:     <system>
Aug 17 10:21:15 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:21:15 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:21:15 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:21:15 user nova-compute[73158]:       <entry name="serial">f8fbae4f-23df-44d8-99bc-992b84cf59ee</entry>
Aug 17 10:21:15 user nova-compute[73158]:       <entry name="uuid">f8fbae4f-23df-44d8-99bc-992b84cf59ee</entry>
Aug 17 10:21:15 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:21:15 user nova-compute[73158]:     </system>
Aug 17 10:21:15 user nova-compute[73158]:   </sysinfo>
Aug 17 10:21:15 user nova-compute[73158]:   <os>
Aug 17 10:21:15 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:21:15 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:21:15 user nova-compute[73158]:   </os>
Aug 17 10:21:15 user nova-compute[73158]:   <features>
Aug 17 10:21:15 user nova-compute[73158]:     <acpi/>
Aug 17 10:21:15 user nova-compute[73158]:     <apic/>
Aug 17 10:21:15 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:21:15 user nova-compute[73158]:   </features>
Aug 17 10:21:15 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:21:15 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:21:15 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:21:15 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:21:15 user nova-compute[73158]:   </clock>
Aug 17 10:21:15 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:21:15 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:21:15 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:21:15 user nova-compute[73158]:   </cpu>
Aug 17 10:21:15 user nova-compute[73158]:   <devices>
Aug 17 10:21:15 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:21:15 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:15 user nova-compute[73158]:       <source dev="/dev/sdc"/>
Aug 17 10:21:15 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:21:15 user nova-compute[73158]:       <serial>21acdb4d-0337-4efe-8449-4d9c1cb82870</serial>
Aug 17 10:21:15 user nova-compute[73158]:     </disk>
Aug 17 10:21:15 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:21:15 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:21:15 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue"/>
Aug 17 10:21:15 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:21:15 user nova-compute[73158]:       <boot order="1"/>
Aug 17 10:21:15 user nova-compute[73158]:     </disk>
Aug 17 10:21:15 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:21:15 user nova-compute[73158]:       <mac address="fa:16:3e:c3:21:c9"/>
Aug 17 10:21:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:21:15 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:21:15 user nova-compute[73158]:       <target dev="tapa069bad2-e3"/>
Aug 17 10:21:15 user nova-compute[73158]:     </interface>
Aug 17 10:21:15 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:21:15 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/console.log" append="off"/>
Aug 17 10:21:15 user nova-compute[73158]:     </serial>
Aug 17 10:21:15 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:21:15 user nova-compute[73158]:     <video>
Aug 17 10:21:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:21:15 user nova-compute[73158]:     </video>
Aug 17 10:21:15 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:21:15 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:21:15 user nova-compute[73158]:     </rng>
Aug 17 10:21:15 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:21:15 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:21:15 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:21:15 user nova-compute[73158]:     </memballoon>
Aug 17 10:21:15 user nova-compute[73158]:   </devices>
Aug 17 10:21:15 user nova-compute[73158]: </domain>
Aug 17 10:21:15 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:21:15 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance destroyed successfully.
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No VIF found with MAC fa:16:3e:c3:21:c9, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:21:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KduBTeJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:17 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:17 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:17 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:21:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de07c1d-c14c-4936-a358-0d8297c215ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:21:17 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7d1d8-ad54-4deb-a2f9-1491f721657d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525] added
Aug 17 10:21:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df02d62-4906-4c01-b2ab-286cb8d11a2d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-e94c86d9-4361-4adf-9c63-392dfdb3a47a req-2333bbdd-32c0-46c9-8c48-d888afe70852 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e94c86d9-4361-4adf-9c63-392dfdb3a47a req-2333bbdd-32c0-46c9-8c48-d888afe70852 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e94c86d9-4361-4adf-9c63-392dfdb3a47a req-2333bbdd-32c0-46c9-8c48-d888afe70852 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e94c86d9-4361-4adf-9c63-392dfdb3a47a req-2333bbdd-32c0-46c9-8c48-d888afe70852 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-e94c86d9-4361-4adf-9c63-392dfdb3a47a req-2333bbdd-32c0-46c9-8c48-d888afe70852 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:17 user nova-compute[73158]: WARNING nova.compute.manager [req-e94c86d9-4361-4adf-9c63-392dfdb3a47a req-2333bbdd-32c0-46c9-8c48-d888afe70852 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a68d558-5f3f-4cc1-91bc-40f76c94785e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KduBTeJn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KduBTeJn" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51adfdc9-da83-480b-8a9a-3d61764876be]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KduBTeJn'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4853a9-b5d8-4f9e-961a-580a2a0dc1af]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[02729150-cf8c-4a88-abd6-1ffb3153c659]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:17 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:17 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3ae30-d38d-4518-a58f-fe8752748944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260]
Aug 17 10:21:17 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260] successful.
Aug 17 10:21:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3f8f3-8bb5-4435-8910-4ec81c06ca97]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b674d-ed73-4b2f-88d1-18d7a38ca67d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:17 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:17 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:17 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:17 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[05002809-13f1-45f2-a419-c78e5694a8c2]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:18 user nova-compute[73158]: INFO nova.compute.manager [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Attaching volume 81bda531-49e8-45de-8ef6-a343c1e54216 to /dev/vdb
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.utils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb53f09-22a6-4a2f-ba77-3d4f63895afd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc9468c-c648-440d-8007-5ba500bca9cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66669e37-fbaa-4cd3-afc7-c05582122fdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163d792-b67f-4652-a125-8975967d9d7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:18 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:21:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd202e53-3a0b-487e-9d08-50905ded4390]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.utils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating existing volume attachment record: 04410e55-774d-4386-93f2-ad0006d860af {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KduBTeJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26638646364393539', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638646364393539', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'flavor' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:21:18 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:18 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:21:18 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:21:18 user nova-compute[73158]:   <serial>46720a89-362f-4ba1-b1f1-ec2c198aa525</serial>
Aug 17 10:21:18 user nova-compute[73158]: </disk>
Aug 17 10:21:18 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No VIF found with MAC fa:16:3e:2c:e2:f5, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e8c137a7-c4e0-436f-b26e-1ab83ccc49df tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.705s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb18060d-29cd-4ece-8e74-ecdb0eca5b8b req-e5d356fb-040a-485c-87a2-a5577c89dde3 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb18060d-29cd-4ece-8e74-ecdb0eca5b8b req-e5d356fb-040a-485c-87a2-a5577c89dde3 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb18060d-29cd-4ece-8e74-ecdb0eca5b8b req-e5d356fb-040a-485c-87a2-a5577c89dde3 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb18060d-29cd-4ece-8e74-ecdb0eca5b8b req-e5d356fb-040a-485c-87a2-a5577c89dde3 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb18060d-29cd-4ece-8e74-ecdb0eca5b8b req-e5d356fb-040a-485c-87a2-a5577c89dde3 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:19 user nova-compute[73158]: WARNING nova.compute.manager [req-bb18060d-29cd-4ece-8e74-ecdb0eca5b8b req-e5d356fb-040a-485c-87a2-a5577c89dde3 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for f8fbae4f-23df-44d8-99bc-992b84cf59ee due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267679.4925315, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:21:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Resumed (Lifecycle Event)
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fdb2987e-546b-4013-924e-dc81cdd9ca1b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:21:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267679.5045443, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:21:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Started (Lifecycle Event)
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:21:20 user nova-compute[73158]: INFO nova.compute.manager [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Rescuing
Aug 17 10:21:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-1d9a3996-0720-406b-a627-c62e3c1c8ecb req-7d3e774a-df26-46f6-812d-71222d18844e service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1d9a3996-0720-406b-a627-c62e3c1c8ecb req-7d3e774a-df26-46f6-812d-71222d18844e service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1d9a3996-0720-406b-a627-c62e3c1c8ecb req-7d3e774a-df26-46f6-812d-71222d18844e service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1d9a3996-0720-406b-a627-c62e3c1c8ecb req-7d3e774a-df26-46f6-812d-71222d18844e service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-1d9a3996-0720-406b-a627-c62e3c1c8ecb req-7d3e774a-df26-46f6-812d-71222d18844e service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:21 user nova-compute[73158]: WARNING nova.compute.manager [req-1d9a3996-0720-406b-a627-c62e3c1c8ecb req-7d3e774a-df26-46f6-812d-71222d18844e service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance destroyed successfully.
Aug 17 10:21:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Attempting a stable device rescue
Aug 17 10:21:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73158) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 10:21:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:21:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Creating image(s)
Aug 17 10:21:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:22 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "361a612d803cc11700c3b0c7385d695e3d3f1476" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "361a612d803cc11700c3b0c7385d695e3d3f1476" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.part --force-share --output=json" returned: 0 in 0.225s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG nova.virt.images [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] f1ef8da2-0199-4ec5-bf50-6fa04bd4781c was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.part /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.part /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.converted" returned: 0 in 0.352s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476.converted --force-share --output=json" returned: 0 in 0.253s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "361a612d803cc11700c3b0c7385d695e3d3f1476" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.818s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "361a612d803cc11700c3b0c7385d695e3d3f1476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "361a612d803cc11700c3b0c7385d695e3d3f1476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-9103de03-a914-4abc-981a-4008207bd976 req-036272a9-6511-4295-8e6f-e8e37e5faaf7 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9103de03-a914-4abc-981a-4008207bd976 req-036272a9-6511-4295-8e6f-e8e37e5faaf7 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9103de03-a914-4abc-981a-4008207bd976 req-036272a9-6511-4295-8e6f-e8e37e5faaf7 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9103de03-a914-4abc-981a-4008207bd976 req-036272a9-6511-4295-8e6f-e8e37e5faaf7 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-9103de03-a914-4abc-981a-4008207bd976 req-036272a9-6511-4295-8e6f-e8e37e5faaf7 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:24 user nova-compute[73158]: WARNING nova.compute.manager [req-9103de03-a914-4abc-981a-4008207bd976 req-036272a9-6511-4295-8e6f-e8e37e5faaf7 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476 --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476,backing_fmt=raw /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476,backing_fmt=raw /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue" returned: 0 in 0.088s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "361a612d803cc11700c3b0c7385d695e3d3f1476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'migration_context' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Start _get_guest_xml network_info=[{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "vif_mac": "fa:16:3e:2c:e2:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1ef8da2-0199-4ec5-bf50-6fa04bd4781c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '1310603c-da1a-487d-8b75-98e26361f875', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KduBTeJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a3e106ed-a561-4519-bff8-a911f5e46d4b', 'attached_at': '', 'detached_at': '', 'volume_id': '46720a89-362f-4ba1-b1f1-ec2c198aa525', 'serial': '46720a89-362f-4ba1-b1f1-ec2c198aa525'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'resources' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'numa_topology' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:21:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KduBTeJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:24 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:24 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:24 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc21b50-146a-411f-986b-90d38fbee2e3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KduBTeJn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 10:21:24 user nova-compute[73158]: node.name = iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525
Aug 17 10:21:24 user nova-compute[73158]: node.tpgt = -1
Aug 17 10:21:24 user nova-compute[73158]: node.startup = automatic
Aug 17 10:21:24 user nova-compute[73158]: node.leading_login = No
Aug 17 10:21:24 user nova-compute[73158]: iface.iscsi_ifacename = default
Aug 17 10:21:24 user nova-compute[73158]: iface.net_ifacename = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.ipaddress = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.prefix_len = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.hwaddress = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.transport_name = tcp
Aug 17 10:21:24 user nova-compute[73158]: iface.initiatorname = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.vlan_id = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.vlan_priority = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.vlan_state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.iface_num = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.mtu = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.port = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.bootproto = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.subnet_mask = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.gateway = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_alt_client_id = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_dns = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_learn_iqn = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_vendor_id_state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_vendor_id = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.dhcp_slp_da = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.fragmentation = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.gratuitous_arp = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.incoming_forwarding = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.tos_state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.tos = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.ttl = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.delayed_ack = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.tcp_nagle = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.tcp_wsf_state = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.tcp_wsf = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.tcp_timer_scale = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.tcp_timestamp = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.redirect = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.def_task_mgmt_timeout = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.header_digest = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.data_digest = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.immediate_data = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.initial_r2t = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.data_seq_inorder = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.data_pdu_inorder = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.erl = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.max_receive_data_len = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.first_burst_len = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.max_outstanding_r2t = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.max_burst_len = 0
Aug 17 10:21:24 user nova-compute[73158]: iface.chap_auth = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.bidi_chap = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.strict_login_compliance = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.discovery_auth = <empty>
Aug 17 10:21:24 user nova-compute[73158]: iface.discovery_logout = <empty>
Aug 17 10:21:24 user nova-compute[73158]: node.discovery_address = <empty>
Aug 17 10:21:24 user nova-compute[73158]: node.discovery_port = 0
Aug 17 10:21:24 user nova-compute[73158]: node.discovery_type = static
Aug 17 10:21:24 user nova-compute[73158]: node.session.initial_cmdsn = 0
Aug 17 10:21:24 user nova-compute[73158]: node.session.initial_login_retry_max = 8
Aug 17 10:21:24 user nova-compute[73158]: node.session.xmit_thread_priority = -20
Aug 17 10:21:24 user nova-compute[73158]: node.session.cmds_max = 128
Aug 17 10:21:24 user nova-compute[73158]: node.session.queue_depth = 32
Aug 17 10:21:24 user nova-compute[73158]: node.session.nr_sessions = 1
Aug 17 10:21:24 user nova-compute[73158]: node.session.auth.authmethod = CHAP
Aug 17 10:21:24 user nova-compute[73158]: node.session.auth.username = KduBTeJn
Aug 17 10:21:24 user nova-compute[73158]: node.session.auth.password = ***
Aug 17 10:21:24 user nova-compute[73158]: node.session.auth.username_in = <empty>
Aug 17 10:21:24 user nova-compute[73158]: node.session.auth.password_in = <empty>
Aug 17 10:21:24 user nova-compute[73158]: node.session.auth.chap_algs = MD5
Aug 17 10:21:24 user nova-compute[73158]: node.session.timeo.replacement_timeout = 120
Aug 17 10:21:24 user nova-compute[73158]: node.session.err_timeo.abort_timeout = 15
Aug 17 10:21:24 user nova-compute[73158]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 10:21:24 user nova-compute[73158]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 10:21:24 user nova-compute[73158]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.FastAbort = Yes
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.InitialR2T = No
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.ImmediateData = Yes
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.MaxConnections = 1
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 10:21:24 user nova-compute[73158]: node.session.iscsi.ERL = 0
Aug 17 10:21:24 user nova-compute[73158]: node.session.scan = manual
Aug 17 10:21:24 user nova-compute[73158]: node.session.reopen_max = 0
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].address = 172.16.0.220
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].port = 3260
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].startup = manual
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].tcp.window_size = 524288
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].tcp.type_of_service = 0
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].timeo.logout_timeout = 15
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].timeo.login_timeout = 15
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].timeo.auth_timeout = 45
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].iscsi.DataDigest = None
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].iscsi.IFMarker = No
Aug 17 10:21:24 user nova-compute[73158]: node.conn[0].iscsi.OFMarker = No
Aug 17 10:21:24 user nova-compute[73158]: # END RECORD
Aug 17 10:21:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa5ad35-e80b-48c5-803c-1fb7726433c0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6491f2f-f9b1-4ce7-8410-ed60723a483c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KduBTeJn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KduBTeJn" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee7261f-a0c5-45c8-9e48-a669e3b0d308]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KduBTeJn'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb84105-a3fc-4615-b53c-d8fb7043dfe0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a74a4a-373d-4511-a1fd-b64960906bc3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:24 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:24 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:24 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:24 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] HCTL ('33', '0', '0', 0) found on session 21 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ff3ed-62e2-487d-8275-67d12b796d85]: (4, ('0 0 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Searching for a device in session 21 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KduBTeJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '26638646364393539', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638646364393539', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2006961583',display_name='tempest-ServerStableDeviceRescueTest-server-2006961583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2006961583',id=18,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYx+MQ9jBtSnlZpT+DBE6krXkBjkA+0nJFJbt+ICPaMhJLEuSMyfCwWGQShRsF1DLX9iM1onVAoHR1ebCKPgvBE/VMphZRpVv9fAB3AR1M1oLqMkZdCqH/nIVrz298Fw==',key_name='tempest-keypair-1238312178',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26a300e5d1364d659313c9188a1edcf9',ramdisk_id='',reservation_id='r-b56pkd56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2030255454',owner_user_name='tempest-ServerStableDeviceRescueTest-2030255454-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b067ceed67741b8acb93ab97ba02b66',uuid=a3e106ed-a561-4519-bff8-a911f5e46d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "vif_mac": "fa:16:3e:2c:e2:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converting VIF {"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "vif_mac": "fa:16:3e:2c:e2:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'pci_devices' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:21:24 user nova-compute[73158]:   <uuid>a3e106ed-a561-4519-bff8-a911f5e46d4b</uuid>
Aug 17 10:21:24 user nova-compute[73158]:   <name>instance-00000012</name>
Aug 17 10:21:24 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:21:24 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:21:24 user nova-compute[73158]:   <metadata>
Aug 17 10:21:24 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:21:24 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:21:24 user nova-compute[73158]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2006961583</nova:name>
Aug 17 10:21:24 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:21:24</nova:creationTime>
Aug 17 10:21:24 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:21:24 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:21:24 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:21:24 user nova-compute[73158]:       <nova:owner>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:user uuid="6b067ceed67741b8acb93ab97ba02b66">tempest-ServerStableDeviceRescueTest-2030255454-project-member</nova:user>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:project uuid="26a300e5d1364d659313c9188a1edcf9">tempest-ServerStableDeviceRescueTest-2030255454</nova:project>
Aug 17 10:21:24 user nova-compute[73158]:       </nova:owner>
Aug 17 10:21:24 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:21:24 user nova-compute[73158]:       <nova:ports>
Aug 17 10:21:24 user nova-compute[73158]:         <nova:port uuid="ac4b8c1e-6806-40ab-990f-4686051d1286">
Aug 17 10:21:24 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:21:24 user nova-compute[73158]:         </nova:port>
Aug 17 10:21:24 user nova-compute[73158]:       </nova:ports>
Aug 17 10:21:24 user nova-compute[73158]:     </nova:instance>
Aug 17 10:21:24 user nova-compute[73158]:   </metadata>
Aug 17 10:21:24 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:21:24 user nova-compute[73158]:     <system>
Aug 17 10:21:24 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:21:24 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:21:24 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:21:24 user nova-compute[73158]:       <entry name="serial">a3e106ed-a561-4519-bff8-a911f5e46d4b</entry>
Aug 17 10:21:24 user nova-compute[73158]:       <entry name="uuid">a3e106ed-a561-4519-bff8-a911f5e46d4b</entry>
Aug 17 10:21:24 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:21:24 user nova-compute[73158]:     </system>
Aug 17 10:21:24 user nova-compute[73158]:   </sysinfo>
Aug 17 10:21:24 user nova-compute[73158]:   <os>
Aug 17 10:21:24 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:21:24 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:21:24 user nova-compute[73158]:   </os>
Aug 17 10:21:24 user nova-compute[73158]:   <features>
Aug 17 10:21:24 user nova-compute[73158]:     <acpi/>
Aug 17 10:21:24 user nova-compute[73158]:     <apic/>
Aug 17 10:21:24 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:21:24 user nova-compute[73158]:   </features>
Aug 17 10:21:24 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:21:24 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:21:24 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:21:24 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:21:24 user nova-compute[73158]:   </clock>
Aug 17 10:21:24 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:21:24 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:21:24 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:21:24 user nova-compute[73158]:   </cpu>
Aug 17 10:21:24 user nova-compute[73158]:   <devices>
Aug 17 10:21:24 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:21:24 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:21:24 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk"/>
Aug 17 10:21:24 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:21:24 user nova-compute[73158]:     </disk>
Aug 17 10:21:24 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:21:24 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:24 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:21:24 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:21:24 user nova-compute[73158]:       <serial>46720a89-362f-4ba1-b1f1-ec2c198aa525</serial>
Aug 17 10:21:24 user nova-compute[73158]:     </disk>
Aug 17 10:21:24 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:21:24 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:21:24 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue"/>
Aug 17 10:21:24 user nova-compute[73158]:       <target dev="vdc" bus="virtio"/>
Aug 17 10:21:24 user nova-compute[73158]:       <boot order="1"/>
Aug 17 10:21:24 user nova-compute[73158]:     </disk>
Aug 17 10:21:24 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:21:24 user nova-compute[73158]:       <mac address="fa:16:3e:2c:e2:f5"/>
Aug 17 10:21:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:21:24 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:21:24 user nova-compute[73158]:       <target dev="tapac4b8c1e-68"/>
Aug 17 10:21:24 user nova-compute[73158]:     </interface>
Aug 17 10:21:24 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:21:24 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/console.log" append="off"/>
Aug 17 10:21:24 user nova-compute[73158]:     </serial>
Aug 17 10:21:24 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:21:24 user nova-compute[73158]:     <video>
Aug 17 10:21:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:21:24 user nova-compute[73158]:     </video>
Aug 17 10:21:24 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:21:24 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:21:24 user nova-compute[73158]:     </rng>
Aug 17 10:21:24 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:21:24 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:21:24 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:21:24 user nova-compute[73158]:     </memballoon>
Aug 17 10:21:24 user nova-compute[73158]:   </devices>
Aug 17 10:21:24 user nova-compute[73158]: </domain>
Aug 17 10:21:24 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:21:24 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance destroyed successfully.
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] No VIF found with MAC fa:16:3e:2c:e2:f5, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updating instance_info_cache with network_info: [{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'flavor' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-58100f00-25d8-40f9-b77e-b6cd23c14e6f req-5dfed95e-1140-4fe8-9b48-d8797963785b service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-58100f00-25d8-40f9-b77e-b6cd23c14e6f req-5dfed95e-1140-4fe8-9b48-d8797963785b service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-58100f00-25d8-40f9-b77e-b6cd23c14e6f req-5dfed95e-1140-4fe8-9b48-d8797963785b service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-58100f00-25d8-40f9-b77e-b6cd23c14e6f req-5dfed95e-1140-4fe8-9b48-d8797963785b service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-58100f00-25d8-40f9-b77e-b6cd23c14e6f req-5dfed95e-1140-4fe8-9b48-d8797963785b service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:26 user nova-compute[73158]: WARNING nova.compute.manager [req-58100f00-25d8-40f9-b77e-b6cd23c14e6f req-5dfed95e-1140-4fe8-9b48-d8797963785b service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:26 user nova-compute[73158]: INFO nova.compute.manager [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Attaching volume 3474c7db-e686-4c34-9bd5-1ac0f576fd31 to /dev/vdb
Aug 17 10:21:26 user nova-compute[73158]: DEBUG os_brick.utils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c9e50-2199-42a5-94aa-03623b66efce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30de21f-f2c2-4197-9400-1b7289d5ef42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6041d9b6-f24c-4285-be86-c458fe7b38a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2482ef-cdc0-4e96-af05-7d720a65115f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:27 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f6bd06-e73e-44e7-99c9-6dbb2a33cd94]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG os_brick.utils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating existing volume attachment record: bc77f2b1-df10-4232-8509-627cb73a714f {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267672.3052678, d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:21:27 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] VM Stopped (Lifecycle Event)
Aug 17 10:21:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-6f1eec94-16ba-4787-8110-72ef0fc1698b None None] [instance: d6cf8d8b-15c1-436c-8e8f-5e1f03c0e09f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-00aafad3-e7d1-46ea-8a8c-ed57413390fc req-697aa27c-815a-4860-b3b8-48799e2d4ae1 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-00aafad3-e7d1-46ea-8a8c-ed57413390fc req-697aa27c-815a-4860-b3b8-48799e2d4ae1 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-00aafad3-e7d1-46ea-8a8c-ed57413390fc req-697aa27c-815a-4860-b3b8-48799e2d4ae1 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-00aafad3-e7d1-46ea-8a8c-ed57413390fc req-697aa27c-815a-4860-b3b8-48799e2d4ae1 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-00aafad3-e7d1-46ea-8a8c-ed57413390fc req-697aa27c-815a-4860-b3b8-48799e2d4ae1 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:28 user nova-compute[73158]: WARNING nova.compute.manager [req-00aafad3-e7d1-46ea-8a8c-ed57413390fc req-697aa27c-815a-4860-b3b8-48799e2d4ae1 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state active and task_state rescuing.
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for a3e106ed-a561-4519-bff8-a911f5e46d4b due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267688.791472, a3e106ed-a561-4519-bff8-a911f5e46d4b => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:21:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Resumed (Lifecycle Event)
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a6762169-ddf3-42bd-8526-095d07e7a274 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:21:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267688.7929552, a3e106ed-a561-4519-bff8-a911f5e46d4b => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:21:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Started (Lifecycle Event)
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:21:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:21:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:33 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:21:33 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:21:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=24.15412139892578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:21:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f3c36a7f-508a-4121-a6ba-a9ea65ff0699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:34 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:34 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:34 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3b32f3-db54-4dc4-aac5-fb0eed29ed67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:21:34 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03465b-36ce-4d1d-be9b-120e015c0480]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216] added
Aug 17 10:21:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd165fc2-7493-4759-8f1b-04568fb10c50]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d01937-dbf7-45e1-a14c-5cee0b196e4f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWQAOaoI {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWQAOaoI" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a3b1b-e945-40b8-b198-ffda13c7531f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pWQAOaoI'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[011682d8-23fb-47bb-9386-fcef545087ae]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4130475-aee2-415b-8f43-b94234d61a08]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8713a29-3d08-4ccb-91fb-6c25a80a47fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]
Aug 17 10:21:34 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.
Aug 17 10:21:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaa9a95-e111-436b-9bbe-efec16a5aae1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d150a1-10f4-4515-b03a-ea5a558f5d61]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4d6a7b-2a4e-49fa-98a1-69b3c7651b60]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26563376537383331', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563376537383331', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:21:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:21:35 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:35 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:21:35 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:21:35 user nova-compute[73158]:   <serial>81bda531-49e8-45de-8ef6-a343c1e54216</serial>
Aug 17 10:21:35 user nova-compute[73158]: </disk>
Aug 17 10:21:35 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:21:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No VIF found with MAC fa:16:3e:c1:86:11, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:21:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76bac3f5-da8f-468d-92cb-55a5db25a764 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.393s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73158) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG nova.compute.manager [req-0aa4a09b-a8d2-4627-8367-1e6cec179d09 req-368a898f-2624-4a93-a89e-c3a3a8dd8397 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0aa4a09b-a8d2-4627-8367-1e6cec179d09 req-368a898f-2624-4a93-a89e-c3a3a8dd8397 service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0aa4a09b-a8d2-4627-8367-1e6cec179d09 req-368a898f-2624-4a93-a89e-c3a3a8dd8397 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0aa4a09b-a8d2-4627-8367-1e6cec179d09 req-368a898f-2624-4a93-a89e-c3a3a8dd8397 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:37 user nova-compute[73158]: DEBUG nova.compute.manager [req-0aa4a09b-a8d2-4627-8367-1e6cec179d09 req-368a898f-2624-4a93-a89e-c3a3a8dd8397 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:37 user nova-compute[73158]: WARNING nova.compute.manager [req-0aa4a09b-a8d2-4627-8367-1e6cec179d09 req-368a898f-2624-4a93-a89e-c3a3a8dd8397 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state active and task_state powering-off.
Aug 17 10:21:38 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance destroyed successfully.
Aug 17 10:21:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3806958d-02f1-4f16-8b11-b4e51e8def52 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.287s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-042690d2-8a3a-4dd2-9e11-9a34e30296bf req-08d57101-ed62-49b9-b450-bf476a2e1231 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-042690d2-8a3a-4dd2-9e11-9a34e30296bf req-08d57101-ed62-49b9-b450-bf476a2e1231 service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-042690d2-8a3a-4dd2-9e11-9a34e30296bf req-08d57101-ed62-49b9-b450-bf476a2e1231 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-042690d2-8a3a-4dd2-9e11-9a34e30296bf req-08d57101-ed62-49b9-b450-bf476a2e1231 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-042690d2-8a3a-4dd2-9e11-9a34e30296bf req-08d57101-ed62-49b9-b450-bf476a2e1231 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:39 user nova-compute[73158]: WARNING nova.compute.manager [req-042690d2-8a3a-4dd2-9e11-9a34e30296bf req-08d57101-ed62-49b9-b450-bf476a2e1231 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state stopped and task_state None.
Aug 17 10:21:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:41 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:41 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:41 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd25231-1b01-4c71-bdbe-d3a0350803ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:21:41 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a2857-38d9-4176-9491-09a53a0fa2a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31] added
Aug 17 10:21:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd40385a-6a4a-466f-91ee-a031c55be264]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ff147a-7f42-4d88-9961-e6b906892478]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebjOowFy {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebjOowFy" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3894d621-f07e-4b2f-b76b-f11cd22b09f0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ebjOowFy'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bfd27d-4e41-42d7-85b8-119e41ca618d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9e0fd-7a00-4b65-a167-7914f2cd976d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[85848df8-c899-46b6-bf92-1c52c7acf103]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]
Aug 17 10:21:41 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.
Aug 17 10:21:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e420405-f3bb-4c3e-aa81-e9f44d2fa50d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbdaa5c-fc48-4e35-81e0-3057fd27fc2a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:21:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fe9ce4-1cc4-4616-8a63-86d05aa34ece]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:21:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:21:42 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:42 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23630613233333635', 'path': '/dev/sdg'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630613233333635', 'path': '/dev/sdg'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:21:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'flavor' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:21:42 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:21:42 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:21:42 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:21:42 user nova-compute[73158]:   <serial>3474c7db-e686-4c34-9bd5-1ac0f576fd31</serial>
Aug 17 10:21:42 user nova-compute[73158]: </disk>
Aug 17 10:21:42 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:21:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:21:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No VIF found with MAC fa:16:3e:80:1e:65, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:21:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a3d51ee7-f55b-4e33-9696-1b68dfc725df tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.202s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Stashing vm_state: active {{(pid=73158) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'pci_requests' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:21:46 user nova-compute[73158]: INFO nova.compute.claims [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Claim successful on node user
Aug 17 10:21:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'resources' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:47 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating resource usage from migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0
Aug 17 10:21:47 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.552s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:47 user nova-compute[73158]: INFO nova.compute.manager [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Migrating
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:47 user nova-compute[73158]: INFO nova.compute.rpcapi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Starting migrate_disk_and_power_off {{(pid=73158) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-891ba5fe-9628-41b9-a68b-7faac9d9bc61 req-10a136f3-7951-46f4-8497-970f9c61bc5e service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891ba5fe-9628-41b9-a68b-7faac9d9bc61 req-10a136f3-7951-46f4-8497-970f9c61bc5e service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891ba5fe-9628-41b9-a68b-7faac9d9bc61 req-10a136f3-7951-46f4-8497-970f9c61bc5e service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-891ba5fe-9628-41b9-a68b-7faac9d9bc61 req-10a136f3-7951-46f4-8497-970f9c61bc5e service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-891ba5fe-9628-41b9-a68b-7faac9d9bc61 req-10a136f3-7951-46f4-8497-970f9c61bc5e service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:48 user nova-compute[73158]: WARNING nova.compute.manager [req-891ba5fe-9628-41b9-a68b-7faac9d9bc61 req-10a136f3-7951-46f4-8497-970f9c61bc5e service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state active and task_state resize_migrating.
Aug 17 10:21:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance destroyed successfully.
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG os_vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94d3ea77-5e, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:48 user nova-compute[73158]: INFO os_vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e')
Aug 17 10:21:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:48 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:21:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:21:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c8daf-7647-41df-a657-cf9b67bfe750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[79642e2a-9dd4-4f5c-9bea-0b876baed122]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c2b33-1544-4f50-a826-09bdda629810 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:21:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c66dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'): ({'sdg'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Removing single pathed devices sdg {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7fe182-3dfd-41a6-a39e-1fc8dd4c6759]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e045395-042b-40e0-b3e3-3f4601d5a094]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flushing IO for device /dev/sdg {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4cc0cf-f7ee-45f5-915d-9ef635fcd32d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7af3682-f984-4950-ad89-a912ad668029]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea4a84-2257-40f8-8630-dc7af849bb73]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c58d1-c711-4424-84e6-950ddbfbcfb2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]
Aug 17 10:21:49 user nova-compute[73158]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.
Aug 17 10:21:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9055a2cc-fc13-4475-b2a0-46869e2d6119]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== disconnect_volume: return (324ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:21:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee_resize/disk /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "cp -r /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee_resize/disk /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk" returned: 0 in 0.592s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee_resize/disk.info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk.info {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "cp -r /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee_resize/disk.info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk.info" returned: 0 in 0.057s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-d9123ca2-1858-4f8c-9b78-0ec359954a2b req-fb5d47b4-fdb1-46ec-84ee-24e550549b84 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d9123ca2-1858-4f8c-9b78-0ec359954a2b req-fb5d47b4-fdb1-46ec-84ee-24e550549b84 service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d9123ca2-1858-4f8c-9b78-0ec359954a2b req-fb5d47b4-fdb1-46ec-84ee-24e550549b84 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d9123ca2-1858-4f8c-9b78-0ec359954a2b req-fb5d47b4-fdb1-46ec-84ee-24e550549b84 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-d9123ca2-1858-4f8c-9b78-0ec359954a2b req-fb5d47b4-fdb1-46ec-84ee-24e550549b84 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:21:50 user nova-compute[73158]: WARNING nova.compute.manager [req-d9123ca2-1858-4f8c-9b78-0ec359954a2b req-fb5d47b4-fdb1-46ec-84ee-24e550549b84 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state active and task_state resize_migrating.
Aug 17 10:21:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Port 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 binding to destination host user is already ACTIVE {{(pid=73158) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing instance network info cache due to event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG nova.network.neutron [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'flavor' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267698.0192587, a6744f73-a7ec-4388-8e15-c05068041a09 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:21:53 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Stopped (Lifecycle Event)
Aug 17 10:21:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-63140e75-f927-47bf-ad13-9531d3c7dd33 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:21:53 user nova-compute[73158]: INFO nova.compute.manager [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Attaching volume d5845dd9-f0e3-439f-8630-6fc85f0748d0 to /dev/vdb
Aug 17 10:21:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-63140e75-f927-47bf-ad13-9531d3c7dd33 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb17f8f-3d08-4967-b622-9b1c16d1aea3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bccf41d-6046-43dd-ba88-c3826bdfd2a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728807e-bb57-49e5-ba10-649e5e360ffc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b743163a-8889-41bc-ab4a-cecb925e96c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9142d850-8b5d-46f0-8836-5f4f5349491b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[431aded0-0291-4c40-afe7-5474c081ede7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updated VIF entry in instance network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a4a1df-63df-4417-b399-710b1bbeca35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb889b12-a2b6-4681-bf13-3132ba7fdb14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:53 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[683a0662-cb44-4837-86d7-7129e1c6869c]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a71a6867-babc-4cf7-ab48-3eeb0faea74a req-3bf8b900-37d9-4224-9d44-9f63dd20ca9f service nova] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] <== get_connector_properties: return (230ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating existing volume attachment record: 9d61674a-900e-4231-aba0-d7fc1a460c67 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:21:53 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:21:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f15f30-64eb-4b94-8102-36f7eec340ec]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:21:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:21:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:03 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267708.9517002, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:03 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Stopped (Lifecycle Event)
Aug 17 10:22:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-930a49db-6687-4f81-b038-931eec23a0f2 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-930a49db-6687-4f81-b038-931eec23a0f2 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:04 user nova-compute[73158]: INFO nova.compute.manager [None req-930a49db-6687-4f81-b038-931eec23a0f2 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 10:22:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Starting finish_migration {{(pid=73158) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 10:22:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:22:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Creating image(s)
Aug 17 10:22:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk. size=21474836480 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMajStsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:22:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:22:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:22:05 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7424fe6-c879-43c8-bf8f-50a8154a4415]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:22:05 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd58615-f4de-422f-b7a6-e7eb26393a3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0] added
Aug 17 10:22:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[86935e66-7b00-4394-b008-e7b20f4488ef]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81419083-2a52-43b6-b0f7-13320f02807c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMajStsW {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMajStsW" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ff6a6-ff55-4cc8-96f9-75b4351a8166]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk 21474836480 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMajStsW'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk 21474836480" returned: 0 in 0.052s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[389913b8-9bc3-4eef-a90c-f19993211159]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start _get_guest_xml network_info=[{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': 'ac508c17-c3de-4ee0-a9ee-8b6aa6d26aa3', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4fe9c190-01f0-4d1c-af66-cd61aa8334ee', 'attached_at': '2023-08-17T10:22:05.000000', 'detached_at': '', 'volume_id': '3474c7db-e686-4c34-9bd5-1ac0f576fd31', 'serial': '3474c7db-e686-4c34-9bd5-1ac0f576fd31'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f8e0c6-f11c-47d3-aff3-52bdf6c60a1d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:05 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:22:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89f54e9-0c43-4520-ad8e-e274c3d34643]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260]
Aug 17 10:22:05 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260] successful.
Aug 17 10:22:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc063d-fd5b-46af-bcf4-f1af0f83ce01]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf1494-880a-4c44-87c9-4367017a0a91]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:22:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f9d1f-c33d-47f4-9d8f-2ab18cc00808]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:22:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMajStsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26363643064396232', 'path': '/dev/sde'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363643064396232', 'path': '/dev/sde'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.119s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:22:06 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:22:06 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'flavor' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c00069-a067-45f1-a4b6-ad7bddd7c19a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:22:06 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:22:06 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:22:06 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:22:06 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:22:06 user nova-compute[73158]:   <serial>d5845dd9-f0e3-439f-8630-6fc85f0748d0</serial>
Aug 17 10:22:06 user nova-compute[73158]: </disk>
Aug 17 10:22:06 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367d66a-a8a6-476b-8b59-0f1d98dc192d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31] added
Aug 17 10:22:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d11fec-c2d6-404e-ab9f-7071364a9a1e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58e7eb-c2a1-4477-a573-5a3e54e5bb3b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebjOowFy {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebjOowFy" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a701a73d-8b85-4686-a370-e24f15276e0e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ebjOowFy'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bacc68e-cc64-4086-9821-02f56d570289]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fba87a-3a04-4d55-be50-c71f9c0bf85d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:22:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8bd0b-64ba-405e-9a7f-23527c38a67e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]
Aug 17 10:22:06 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.
Aug 17 10:22:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d4ddd-b2f1-4629-9be4-713409cf07f3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f27cb-b1a8-412b-b31a-15f1ab7122ea]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:22:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a7e09-b0db-4fc2-b8ba-b1c991522004]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:01:84:45, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:22:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d313332e-ca9c-4eb2-b36a-0406a4cdc611 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.641s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== connect_volume: return (2528ms) {'type': 'block', 'scsi_wwn': '23630613233333635', 'path': '/dev/sdg'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630613233333635', 'path': '/dev/sdg'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:22:08 user nova-compute[73158]:   <uuid>4fe9c190-01f0-4d1c-af66-cd61aa8334ee</uuid>
Aug 17 10:22:08 user nova-compute[73158]:   <name>instance-00000013</name>
Aug 17 10:22:08 user nova-compute[73158]:   <memory>2097152</memory>
Aug 17 10:22:08 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:22:08 user nova-compute[73158]:   <metadata>
Aug 17 10:22:08 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:22:08 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:22:08 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherB-server-1669003801</nova:name>
Aug 17 10:22:08 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:22:05</nova:creationTime>
Aug 17 10:22:08 user nova-compute[73158]:       <nova:flavor name="m1.small">
Aug 17 10:22:08 user nova-compute[73158]:         <nova:memory>2048</nova:memory>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:disk>20</nova:disk>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:22:08 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:22:08 user nova-compute[73158]:       <nova:owner>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:user uuid="d3434dc3b8af4c6dae565ddeb206e201">tempest-ServerActionsTestOtherB-1114975532-project-member</nova:user>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:project uuid="9b7160dba7264083b524295f3d5028e8">tempest-ServerActionsTestOtherB-1114975532</nova:project>
Aug 17 10:22:08 user nova-compute[73158]:       </nova:owner>
Aug 17 10:22:08 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:22:08 user nova-compute[73158]:       <nova:ports>
Aug 17 10:22:08 user nova-compute[73158]:         <nova:port uuid="94d3ea77-5eb2-4eaf-b0e8-150394cce1a2">
Aug 17 10:22:08 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:22:08 user nova-compute[73158]:         </nova:port>
Aug 17 10:22:08 user nova-compute[73158]:       </nova:ports>
Aug 17 10:22:08 user nova-compute[73158]:     </nova:instance>
Aug 17 10:22:08 user nova-compute[73158]:   </metadata>
Aug 17 10:22:08 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:22:08 user nova-compute[73158]:     <system>
Aug 17 10:22:08 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:22:08 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:22:08 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:22:08 user nova-compute[73158]:       <entry name="serial">4fe9c190-01f0-4d1c-af66-cd61aa8334ee</entry>
Aug 17 10:22:08 user nova-compute[73158]:       <entry name="uuid">4fe9c190-01f0-4d1c-af66-cd61aa8334ee</entry>
Aug 17 10:22:08 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:22:08 user nova-compute[73158]:     </system>
Aug 17 10:22:08 user nova-compute[73158]:   </sysinfo>
Aug 17 10:22:08 user nova-compute[73158]:   <os>
Aug 17 10:22:08 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:22:08 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:22:08 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:22:08 user nova-compute[73158]:   </os>
Aug 17 10:22:08 user nova-compute[73158]:   <features>
Aug 17 10:22:08 user nova-compute[73158]:     <acpi/>
Aug 17 10:22:08 user nova-compute[73158]:     <apic/>
Aug 17 10:22:08 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:22:08 user nova-compute[73158]:   </features>
Aug 17 10:22:08 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:22:08 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:22:08 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:22:08 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:22:08 user nova-compute[73158]:   </clock>
Aug 17 10:22:08 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:22:08 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:22:08 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:22:08 user nova-compute[73158]:   </cpu>
Aug 17 10:22:08 user nova-compute[73158]:   <devices>
Aug 17 10:22:08 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:22:08 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:22:08 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk"/>
Aug 17 10:22:08 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:22:08 user nova-compute[73158]:     </disk>
Aug 17 10:22:08 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:22:08 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:22:08 user nova-compute[73158]:       <source dev="/dev/sdg"/>
Aug 17 10:22:08 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:22:08 user nova-compute[73158]:       <serial>3474c7db-e686-4c34-9bd5-1ac0f576fd31</serial>
Aug 17 10:22:08 user nova-compute[73158]:     </disk>
Aug 17 10:22:08 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:22:08 user nova-compute[73158]:       <mac address="fa:16:3e:80:1e:65"/>
Aug 17 10:22:08 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:22:08 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:22:08 user nova-compute[73158]:       <target dev="tap94d3ea77-5e"/>
Aug 17 10:22:08 user nova-compute[73158]:     </interface>
Aug 17 10:22:08 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:22:08 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/console.log" append="off"/>
Aug 17 10:22:08 user nova-compute[73158]:     </serial>
Aug 17 10:22:08 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:22:08 user nova-compute[73158]:     <video>
Aug 17 10:22:08 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:22:08 user nova-compute[73158]:     </video>
Aug 17 10:22:08 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:22:08 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:22:08 user nova-compute[73158]:     </rng>
Aug 17 10:22:08 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:22:08 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:22:08 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:22:08 user nova-compute[73158]:     </memballoon>
Aug 17 10:22:08 user nova-compute[73158]:   </devices>
Aug 17 10:22:08 user nova-compute[73158]: </domain>
Aug 17 10:22:08 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-178384429-network", "vif_mac": "fa:16:3e:80:1e:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG os_vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94d3ea77-5e, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94d3ea77-5e, col_values=(('external_ids', {'iface-id': '94d3ea77-5eb2-4eaf-b0e8-150394cce1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:1e:65', 'vm-uuid': '4fe9c190-01f0-4d1c-af66-cd61aa8334ee'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:08 user nova-compute[73158]: INFO os_vif [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e')
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] No VIF found with MAC fa:16:3e:80:1e:65, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:22:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Rescuing
Aug 17 10:22:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:22:08 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-changed-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Refreshing instance network info cache due to event network-changed-d9b9654b-a1de-42b4-886f-05461b511f97. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] Acquiring lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] Acquired lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG nova.network.neutron [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Refreshing network info cache for port d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:22:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-47f79d58-7783-430d-bc75-b55794b419cf req-519c95e1-1fca-498b-bb9a-70a548a65020 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-47f79d58-7783-430d-bc75-b55794b419cf req-519c95e1-1fca-498b-bb9a-70a548a65020 service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-47f79d58-7783-430d-bc75-b55794b419cf req-519c95e1-1fca-498b-bb9a-70a548a65020 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-47f79d58-7783-430d-bc75-b55794b419cf req-519c95e1-1fca-498b-bb9a-70a548a65020 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-47f79d58-7783-430d-bc75-b55794b419cf req-519c95e1-1fca-498b-bb9a-70a548a65020 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:10 user nova-compute[73158]: WARNING nova.compute.manager [req-47f79d58-7783-430d-bc75-b55794b419cf req-519c95e1-1fca-498b-bb9a-70a548a65020 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state active and task_state resize_finish.
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Updated VIF entry in instance network info cache for port d9b9654b-a1de-42b4-886f-05461b511f97. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Updating instance_info_cache with network_info: [{"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cdfd8a42-67db-47ac-a4f2-1353bebe521b req-37865a5e-aeca-48fa-8a91-53ba7ef04851 service nova] Releasing lock "refresh_cache-f3c36a7f-508a-4121-a6ba-a9ea65ff0699" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance destroyed successfully.
Aug 17 10:22:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Attempting rescue
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73158) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:22:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Creating image(s)
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'trusted_certs' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.240s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue" returned: 0 in 0.063s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'migration_context' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Start _get_guest_xml network_info=[{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:01:84:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'resources' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'numa_topology' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:11 user nova-compute[73158]: INFO nova.compute.manager [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Terminating instance
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:22:11 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:11 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'vcpu_model' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-239143835',display_name='tempest-ServerRescueNegativeTestJSON-server-239143835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-239143835',id=25,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1eqcpoo3mn87FQrbz6WGDZPG9poda+eeQbUzmujx/GV+udSmpeDN+Ne6TfsLNXxAQ6hoHiCD+6DyVUw1HBdG0gsxD5Sv+mzbtxuAlIG1Fq0lnNWir8YrHr0eXfFVX5Yw==',key_name='tempest-keypair-1755267754',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:20:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-jpvb3hcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc72634020f043308464eca253691603',uuid=447f35f1-f3c6-4f5e-96e7-19399846c8f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:01:84:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "vif_mac": "fa:16:3e:01:84:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'pci_devices' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:22:11 user nova-compute[73158]:   <uuid>447f35f1-f3c6-4f5e-96e7-19399846c8f0</uuid>
Aug 17 10:22:11 user nova-compute[73158]:   <name>instance-00000019</name>
Aug 17 10:22:11 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:22:11 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:22:11 user nova-compute[73158]:   <metadata>
Aug 17 10:22:11 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:22:11 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:22:11 user nova-compute[73158]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-239143835</nova:name>
Aug 17 10:22:11 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:22:11</nova:creationTime>
Aug 17 10:22:11 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:22:11 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:22:11 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:22:11 user nova-compute[73158]:       <nova:owner>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:user uuid="fc72634020f043308464eca253691603">tempest-ServerRescueNegativeTestJSON-1859456269-project-member</nova:user>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:project uuid="0eece5be982b434daf80b44ec022192e">tempest-ServerRescueNegativeTestJSON-1859456269</nova:project>
Aug 17 10:22:11 user nova-compute[73158]:       </nova:owner>
Aug 17 10:22:11 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:22:11 user nova-compute[73158]:       <nova:ports>
Aug 17 10:22:11 user nova-compute[73158]:         <nova:port uuid="7e6a648c-93b5-4e7e-956d-ee5de80ca939">
Aug 17 10:22:11 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 10:22:11 user nova-compute[73158]:         </nova:port>
Aug 17 10:22:11 user nova-compute[73158]:       </nova:ports>
Aug 17 10:22:11 user nova-compute[73158]:     </nova:instance>
Aug 17 10:22:11 user nova-compute[73158]:   </metadata>
Aug 17 10:22:11 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:22:11 user nova-compute[73158]:     <system>
Aug 17 10:22:11 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:22:11 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:22:11 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:22:11 user nova-compute[73158]:       <entry name="serial">447f35f1-f3c6-4f5e-96e7-19399846c8f0</entry>
Aug 17 10:22:11 user nova-compute[73158]:       <entry name="uuid">447f35f1-f3c6-4f5e-96e7-19399846c8f0</entry>
Aug 17 10:22:11 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:22:11 user nova-compute[73158]:     </system>
Aug 17 10:22:11 user nova-compute[73158]:   </sysinfo>
Aug 17 10:22:11 user nova-compute[73158]:   <os>
Aug 17 10:22:11 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:22:11 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:22:11 user nova-compute[73158]:   </os>
Aug 17 10:22:11 user nova-compute[73158]:   <features>
Aug 17 10:22:11 user nova-compute[73158]:     <acpi/>
Aug 17 10:22:11 user nova-compute[73158]:     <apic/>
Aug 17 10:22:11 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:22:11 user nova-compute[73158]:   </features>
Aug 17 10:22:11 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:22:11 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:22:11 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:22:11 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:22:11 user nova-compute[73158]:   </clock>
Aug 17 10:22:11 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:22:11 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:22:11 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:22:11 user nova-compute[73158]:   </cpu>
Aug 17 10:22:11 user nova-compute[73158]:   <devices>
Aug 17 10:22:11 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:22:11 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:22:11 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue"/>
Aug 17 10:22:11 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:22:11 user nova-compute[73158]:     </disk>
Aug 17 10:22:11 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:22:11 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:22:11 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk"/>
Aug 17 10:22:11 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:22:11 user nova-compute[73158]:     </disk>
Aug 17 10:22:11 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:22:11 user nova-compute[73158]:       <mac address="fa:16:3e:01:84:45"/>
Aug 17 10:22:11 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:22:11 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:22:11 user nova-compute[73158]:       <target dev="tap7e6a648c-93"/>
Aug 17 10:22:11 user nova-compute[73158]:     </interface>
Aug 17 10:22:11 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:22:11 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/console.log" append="off"/>
Aug 17 10:22:11 user nova-compute[73158]:     </serial>
Aug 17 10:22:11 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:22:11 user nova-compute[73158]:     <video>
Aug 17 10:22:11 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:22:11 user nova-compute[73158]:     </video>
Aug 17 10:22:11 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:22:11 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:22:11 user nova-compute[73158]:     </rng>
Aug 17 10:22:11 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:22:11 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:22:11 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:22:11 user nova-compute[73158]:     </memballoon>
Aug 17 10:22:11 user nova-compute[73158]:   </devices>
Aug 17 10:22:11 user nova-compute[73158]: </domain>
Aug 17 10:22:11 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance destroyed successfully.
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] No VIF found with MAC fa:16:3e:01:84:45, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:11 user nova-compute[73158]: INFO nova.compute.manager [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] instance snapshotting
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Beginning live snapshot process
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:12 user nova-compute[73158]: WARNING nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state active and task_state resize_finish.
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:12 user nova-compute[73158]: WARNING nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state active and task_state rescuing.
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:12 user nova-compute[73158]: WARNING nova.compute.manager [req-8ffe1736-e76c-4363-9960-b673713b623d req-ebe1568b-c479-4435-8215-e6fb80bc6645 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state active and task_state rescuing.
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Instance destroyed successfully.
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.objects.instance [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'resources' on Instance uuid f3c36a7f-508a-4121-a6ba-a9ea65ff0699 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-267412422',display_name='tempest-AttachVolumeNegativeTest-server-267412422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-267412422',id=26,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+BYxPQL7oP6XJBFlUdYQcfcLytmH3nGvNyExMfeNFD882TIcLngBmAjAMLoKgISBqIkj7lllvJK8KgyVNV0ABMGgbfAP+bbiIs2+4Pmqf4sZg7UgXrK0X2jdeyWKXc9w==',key_name='tempest-keypair-103050085',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-lf1uuzf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=f3c36a7f-508a-4121-a6ba-a9ea65ff0699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "d9b9654b-a1de-42b4-886f-05461b511f97", "address": "fa:16:3e:11:0f:e7", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b9654b-a1", "ovs_interfaceid": "d9b9654b-a1de-42b4-886f-05461b511f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG os_vif [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9b9654b-a1, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267732.2204587, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Resumed (Lifecycle Event)
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:22:12 user nova-compute[73158]: INFO os_vif [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:0f:e7,bridge_name='br-int',has_traffic_filtering=True,id=d9b9654b-a1de-42b4-886f-05461b511f97,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b9654b-a1')
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Deleting instance files /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699_del
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Deletion of /opt/stack/data/nova/instances/f3c36a7f-508a-4121-a6ba-a9ea65ff0699_del complete
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance running successfully.
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267732.2211435, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Started (Lifecycle Event)
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Failed to set time: agent not configured {{(pid=73158) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3db1b403-cca9-4d21-b7d9-a2c49e50438a tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] finish_migration finished successfully. {{(pid=73158) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-7d37ca63-e324-461e-8a9a-afd702671b26 req-1064ae6e-accb-428d-91c4-bd3a6274d3bb service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-unplugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7d37ca63-e324-461e-8a9a-afd702671b26 req-1064ae6e-accb-428d-91c4-bd3a6274d3bb service nova] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7d37ca63-e324-461e-8a9a-afd702671b26 req-1064ae6e-accb-428d-91c4-bd3a6274d3bb service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7d37ca63-e324-461e-8a9a-afd702671b26 req-1064ae6e-accb-428d-91c4-bd3a6274d3bb service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-7d37ca63-e324-461e-8a9a-afd702671b26 req-1064ae6e-accb-428d-91c4-bd3a6274d3bb service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] No waiting events found dispatching network-vif-unplugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-7d37ca63-e324-461e-8a9a-afd702671b26 req-1064ae6e-accb-428d-91c4-bd3a6274d3bb service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-unplugged-d9b9654b-a1de-42b4-886f-05461b511f97 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.compute.manager [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.250s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt5a5uika/aaa5835417094a0599c6e2f4ec45aab6.delta 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt5a5uika/aaa5835417094a0599c6e2f4ec45aab6.delta 1073741824" returned: 0 in 0.059s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 10:22:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] COPY block job progress, current cursor: 131072 final cursor: 75563008 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:22:13 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:22:13 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Took 1.49 seconds to deallocate network for instance.
Aug 17 10:22:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:22:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] No waiting events found dispatching network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:14 user nova-compute[73158]: WARNING nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received unexpected event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 for instance with vm_state deleted and task_state None.
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] Acquiring lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] No waiting events found dispatching network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:14 user nova-compute[73158]: WARNING nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received unexpected event network-vif-plugged-d9b9654b-a1de-42b4-886f-05461b511f97 for instance with vm_state deleted and task_state None.
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ebfd562-7395-49d8-8102-6864d9bf5129 req-96414596-8b93-4594-8000-ade952cada42 service nova] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Received event network-vif-deleted-d9b9654b-a1de-42b4-886f-05461b511f97 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-86bf8b1c-027e-42e9-8e92-1b1b91a9bf2c req-0eb1aae8-954d-411c-8647-739b155d383b service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-86bf8b1c-027e-42e9-8e92-1b1b91a9bf2c req-0eb1aae8-954d-411c-8647-739b155d383b service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-86bf8b1c-027e-42e9-8e92-1b1b91a9bf2c req-0eb1aae8-954d-411c-8647-739b155d383b service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-86bf8b1c-027e-42e9-8e92-1b1b91a9bf2c req-0eb1aae8-954d-411c-8647-739b155d383b service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-86bf8b1c-027e-42e9-8e92-1b1b91a9bf2c req-0eb1aae8-954d-411c-8647-739b155d383b service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:14 user nova-compute[73158]: WARNING nova.compute.manager [req-86bf8b1c-027e-42e9-8e92-1b1b91a9bf2c req-0eb1aae8-954d-411c-8647-739b155d383b service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state active and task_state rescuing.
Aug 17 10:22:14 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Deleted allocations for instance f3c36a7f-508a-4121-a6ba-a9ea65ff0699
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-667de1f9-f76e-4089-acc4-d3371176ed93 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "f3c36a7f-508a-4121-a6ba-a9ea65ff0699" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.590s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:22:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt5a5uika/aaa5835417094a0599c6e2f4ec45aab6.delta /opt/stack/data/nova/instances/snapshots/tmpt5a5uika/aaa5835417094a0599c6e2f4ec45aab6 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt5a5uika/aaa5835417094a0599c6e2f4ec45aab6.delta /opt/stack/data/nova/instances/snapshots/tmpt5a5uika/aaa5835417094a0599c6e2f4ec45aab6" returned: 0 in 0.424s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:15 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Snapshot extracted, beginning image upload
Aug 17 10:22:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-b423f96a-a93c-4827-9792-555d90675b18 req-6389fa00-eaf3-4e04-a98a-2f90ae2c5ed9 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b423f96a-a93c-4827-9792-555d90675b18 req-6389fa00-eaf3-4e04-a98a-2f90ae2c5ed9 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b423f96a-a93c-4827-9792-555d90675b18 req-6389fa00-eaf3-4e04-a98a-2f90ae2c5ed9 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b423f96a-a93c-4827-9792-555d90675b18 req-6389fa00-eaf3-4e04-a98a-2f90ae2c5ed9 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-b423f96a-a93c-4827-9792-555d90675b18 req-6389fa00-eaf3-4e04-a98a-2f90ae2c5ed9 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:16 user nova-compute[73158]: WARNING nova.compute.manager [req-b423f96a-a93c-4827-9792-555d90675b18 req-6389fa00-eaf3-4e04-a98a-2f90ae2c5ed9 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state active and task_state rescuing.
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 447f35f1-f3c6-4f5e-96e7-19399846c8f0 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267737.152867, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:17 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Resumed (Lifecycle Event)
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3ebff1a4-02f2-4a8d-b80e-7e54105b8485 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:17 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267737.1551633, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:17 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Started (Lifecycle Event)
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Snapshot image upload complete
Aug 17 10:22:18 user nova-compute[73158]: INFO nova.compute.manager [None req-c2e0cdf8-5e6e-4bcb-a3ec-2fe42dd9a57c tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Took 6.45 seconds to snapshot the instance on the hypervisor.
Aug 17 10:22:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:22 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:22:22 user nova-compute[73158]: INFO nova.compute.claims [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Claim successful on node user
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:22:23 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.policy [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '908f0da6a47c4ba295fee97cf4e88234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d6d6113124771be6093c99e106c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:22:23 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Creating image(s)
Aug 17 10:22:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "/opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "/opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "/opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "4b1502d26d1eb94f31a266e0a7742188262d1fac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "4b1502d26d1eb94f31a266e0a7742188262d1fac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Successfully created port: c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG nova.virt.images [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] 570f24c4-0ada-457a-8a43-c2a408864bde was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.part /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.part /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.converted" returned: 0 in 0.169s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "4b1502d26d1eb94f31a266e0a7742188262d1fac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.754s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "4b1502d26d1eb94f31a266e0a7742188262d1fac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "4b1502d26d1eb94f31a266e0a7742188262d1fac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Successfully updated port: c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquired lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-changed-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Refreshing instance network info cache due to event network-changed-c4a37a83-ea29-42a9-8f6c-37fec489ba6c. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] Acquiring lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac --force-share --output=json" returned: 0 in 0.223s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac,backing_fmt=raw /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac,backing_fmt=raw /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk 1073741824" returned: 0 in 0.072s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "4b1502d26d1eb94f31a266e0a7742188262d1fac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac --force-share --output=json" returned: 0 in 0.205s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'migration_context' on Instance uuid 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updating instance_info_cache with network_info: [{"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Ensure instance console log exists: /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Releasing lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Instance network_info: |[{"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] Acquired lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Refreshing network info cache for port c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Start _get_guest_xml network_info=[{"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6bd031d00668ef9a24069e99d7b9d7f1',container_format='bare',created_at=2023-08-17T10:22:11Z,direct_url=<?>,disk_format='qcow2',id=570f24c4-0ada-457a-8a43-c2a408864bde,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-611883375',owner='cf8d6d6113124771be6093c99e106c18',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T10:22:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '570f24c4-0ada-457a-8a43-c2a408864bde'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:22:25 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:25 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6bd031d00668ef9a24069e99d7b9d7f1',container_format='bare',created_at=2023-08-17T10:22:11Z,direct_url=<?>,disk_format='qcow2',id=570f24c4-0ada-457a-8a43-c2a408864bde,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-611883375',owner='cf8d6d6113124771be6093c99e106c18',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T10:22:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-51631992',display_name='tempest-TestStampPattern-server-51631992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-51631992',id=27,image_ref='570f24c4-0ada-457a-8a43-c2a408864bde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6XIxP0dCINXqjELSrLNjFiRC+1PldH0AChmBMJ5HNVC3DRW7UR8eVYRzITonCUhH/MtY84G5Nh9wiITQ8XKcYuD0UbRRpWG4DHpqdPsono5MbPBjUhIFJKYjWAejQNwg==',key_name='tempest-TestStampPattern-863239552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8d6d6113124771be6093c99e106c18',ramdisk_id='',reservation_id='r-vp6jnxzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d2dbefd6-afaf-4446-977f-69c0ead85a01',image_min_disk='1',image_min_ram='0',image_owner_id='cf8d6d6113124771be6093c99e106c18',image_owner_project_name='tempest-TestStampPattern-1495454869',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1495454869-project-member',image_user_id='908f0da6a47c4ba295fee97cf4e88234',network_allocated='True',owner_project_name='tempest-TestStampPattern-1495454869',owner_user_name='tempest-TestStampPattern-1495454869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:22:23Z,user_data=None,user_id='908f0da6a47c4ba295fee97cf4e88234',uuid=19672aa4-812e-4a2f-8d96-002fa79b708f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converting VIF {"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'pci_devices' on Instance uuid 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:22:26 user nova-compute[73158]:   <uuid>19672aa4-812e-4a2f-8d96-002fa79b708f</uuid>
Aug 17 10:22:26 user nova-compute[73158]:   <name>instance-0000001b</name>
Aug 17 10:22:26 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:22:26 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:22:26 user nova-compute[73158]:   <metadata>
Aug 17 10:22:26 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:22:26 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:22:26 user nova-compute[73158]:       <nova:name>tempest-TestStampPattern-server-51631992</nova:name>
Aug 17 10:22:26 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:22:25</nova:creationTime>
Aug 17 10:22:26 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:22:26 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:22:26 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:22:26 user nova-compute[73158]:       <nova:owner>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:user uuid="908f0da6a47c4ba295fee97cf4e88234">tempest-TestStampPattern-1495454869-project-member</nova:user>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:project uuid="cf8d6d6113124771be6093c99e106c18">tempest-TestStampPattern-1495454869</nova:project>
Aug 17 10:22:26 user nova-compute[73158]:       </nova:owner>
Aug 17 10:22:26 user nova-compute[73158]:       <nova:root type="image" uuid="570f24c4-0ada-457a-8a43-c2a408864bde"/>
Aug 17 10:22:26 user nova-compute[73158]:       <nova:ports>
Aug 17 10:22:26 user nova-compute[73158]:         <nova:port uuid="c4a37a83-ea29-42a9-8f6c-37fec489ba6c">
Aug 17 10:22:26 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 10:22:26 user nova-compute[73158]:         </nova:port>
Aug 17 10:22:26 user nova-compute[73158]:       </nova:ports>
Aug 17 10:22:26 user nova-compute[73158]:     </nova:instance>
Aug 17 10:22:26 user nova-compute[73158]:   </metadata>
Aug 17 10:22:26 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:22:26 user nova-compute[73158]:     <system>
Aug 17 10:22:26 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:22:26 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:22:26 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:22:26 user nova-compute[73158]:       <entry name="serial">19672aa4-812e-4a2f-8d96-002fa79b708f</entry>
Aug 17 10:22:26 user nova-compute[73158]:       <entry name="uuid">19672aa4-812e-4a2f-8d96-002fa79b708f</entry>
Aug 17 10:22:26 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:22:26 user nova-compute[73158]:     </system>
Aug 17 10:22:26 user nova-compute[73158]:   </sysinfo>
Aug 17 10:22:26 user nova-compute[73158]:   <os>
Aug 17 10:22:26 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:22:26 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:22:26 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:22:26 user nova-compute[73158]:   </os>
Aug 17 10:22:26 user nova-compute[73158]:   <features>
Aug 17 10:22:26 user nova-compute[73158]:     <acpi/>
Aug 17 10:22:26 user nova-compute[73158]:     <apic/>
Aug 17 10:22:26 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:22:26 user nova-compute[73158]:   </features>
Aug 17 10:22:26 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:22:26 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:22:26 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:22:26 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:22:26 user nova-compute[73158]:   </clock>
Aug 17 10:22:26 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:22:26 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:22:26 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:22:26 user nova-compute[73158]:   </cpu>
Aug 17 10:22:26 user nova-compute[73158]:   <devices>
Aug 17 10:22:26 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:22:26 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:22:26 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk"/>
Aug 17 10:22:26 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:22:26 user nova-compute[73158]:     </disk>
Aug 17 10:22:26 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:22:26 user nova-compute[73158]:       <mac address="fa:16:3e:37:40:57"/>
Aug 17 10:22:26 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:22:26 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:22:26 user nova-compute[73158]:       <target dev="tapc4a37a83-ea"/>
Aug 17 10:22:26 user nova-compute[73158]:     </interface>
Aug 17 10:22:26 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:22:26 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/console.log" append="off"/>
Aug 17 10:22:26 user nova-compute[73158]:     </serial>
Aug 17 10:22:26 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:22:26 user nova-compute[73158]:     <video>
Aug 17 10:22:26 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:22:26 user nova-compute[73158]:     </video>
Aug 17 10:22:26 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:22:26 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:22:26 user nova-compute[73158]:     </rng>
Aug 17 10:22:26 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:22:26 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:22:26 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:22:26 user nova-compute[73158]:     </memballoon>
Aug 17 10:22:26 user nova-compute[73158]:   </devices>
Aug 17 10:22:26 user nova-compute[73158]: </domain>
Aug 17 10:22:26 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-51631992',display_name='tempest-TestStampPattern-server-51631992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-51631992',id=27,image_ref='570f24c4-0ada-457a-8a43-c2a408864bde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6XIxP0dCINXqjELSrLNjFiRC+1PldH0AChmBMJ5HNVC3DRW7UR8eVYRzITonCUhH/MtY84G5Nh9wiITQ8XKcYuD0UbRRpWG4DHpqdPsono5MbPBjUhIFJKYjWAejQNwg==',key_name='tempest-TestStampPattern-863239552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8d6d6113124771be6093c99e106c18',ramdisk_id='',reservation_id='r-vp6jnxzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d2dbefd6-afaf-4446-977f-69c0ead85a01',image_min_disk='1',image_min_ram='0',image_owner_id='cf8d6d6113124771be6093c99e106c18',image_owner_project_name='tempest-TestStampPattern-1495454869',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1495454869-project-member',image_user_id='908f0da6a47c4ba295fee97cf4e88234',network_allocated='True',owner_project_name='tempest-TestStampPattern-1495454869',owner_user_name='tempest-TestStampPattern-1495454869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:22:23Z,user_data=None,user_id='908f0da6a47c4ba295fee97cf4e88234',uuid=19672aa4-812e-4a2f-8d96-002fa79b708f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converting VIF {"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG os_vif [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a37a83-ea, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4a37a83-ea, col_values=(('external_ids', {'iface-id': 'c4a37a83-ea29-42a9-8f6c-37fec489ba6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:40:57', 'vm-uuid': '19672aa4-812e-4a2f-8d96-002fa79b708f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:26 user nova-compute[73158]: INFO os_vif [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea')
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No VIF found with MAC fa:16:3e:37:40:57, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.network.neutron [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updated VIF entry in instance network info cache for port c4a37a83-ea29-42a9-8f6c-37fec489ba6c. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG nova.network.neutron [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updating instance_info_cache with network_info: [{"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b1e13264-775f-46f4-8e36-1363ab7758fb req-474bae2e-b3af-40a0-831a-17717586da4a service nova] Releasing lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267732.1388679, f3c36a7f-508a-4121-a6ba-a9ea65ff0699 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:27 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] VM Stopped (Lifecycle Event)
Aug 17 10:22:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-67004c4c-b6cc-4925-b6fa-4ff6b2795c23 None None] [instance: f3c36a7f-508a-4121-a6ba-a9ea65ff0699] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-2fbc9ebe-225e-47d8-9d3e-9efd52fa0ad0 req-2f2c5364-533a-46b7-a53d-9dcd177ed482 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2fbc9ebe-225e-47d8-9d3e-9efd52fa0ad0 req-2f2c5364-533a-46b7-a53d-9dcd177ed482 service nova] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2fbc9ebe-225e-47d8-9d3e-9efd52fa0ad0 req-2f2c5364-533a-46b7-a53d-9dcd177ed482 service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2fbc9ebe-225e-47d8-9d3e-9efd52fa0ad0 req-2f2c5364-533a-46b7-a53d-9dcd177ed482 service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-2fbc9ebe-225e-47d8-9d3e-9efd52fa0ad0 req-2f2c5364-533a-46b7-a53d-9dcd177ed482 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] No waiting events found dispatching network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:28 user nova-compute[73158]: WARNING nova.compute.manager [req-2fbc9ebe-225e-47d8-9d3e-9efd52fa0ad0 req-2f2c5364-533a-46b7-a53d-9dcd177ed482 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received unexpected event network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c for instance with vm_state building and task_state spawning.
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:22:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267749.7635043, 19672aa4-812e-4a2f-8d96-002fa79b708f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] VM Resumed (Lifecycle Event)
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:22:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Instance spawned successfully.
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:29 user nova-compute[73158]: INFO nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267749.7689462, 19672aa4-812e-4a2f-8d96-002fa79b708f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:22:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] VM Started (Lifecycle Event)
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:22:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:22:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:22:30 user nova-compute[73158]: INFO nova.compute.manager [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Took 7.64 seconds to build instance.
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-4ba66035-1070-4bd5-9ca3-bff67c85b1b4 req-4584ad78-535a-4ab9-b172-bf108330743c service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4ba66035-1070-4bd5-9ca3-bff67c85b1b4 req-4584ad78-535a-4ab9-b172-bf108330743c service nova] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4ba66035-1070-4bd5-9ca3-bff67c85b1b4 req-4584ad78-535a-4ab9-b172-bf108330743c service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4ba66035-1070-4bd5-9ca3-bff67c85b1b4 req-4584ad78-535a-4ab9-b172-bf108330743c service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-4ba66035-1070-4bd5-9ca3-bff67c85b1b4 req-4584ad78-535a-4ab9-b172-bf108330743c service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] No waiting events found dispatching network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:22:30 user nova-compute[73158]: WARNING nova.compute.manager [req-4ba66035-1070-4bd5-9ca3-bff67c85b1b4 req-4584ad78-535a-4ab9-b172-bf108330743c service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received unexpected event network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c for instance with vm_state active and task_state None.
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4bdd294b-dbbf-4284-9a1b-203fe875ce78 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.837s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:22:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:22:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:22:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=23.985977172851562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:22:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:22:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:22:31 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Applying migration context for instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee as it has an incoming, in-progress migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0. Migration status is finished {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 10:22:31 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating resource usage from migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 19672aa4-812e-4a2f-8d96-002fa79b708f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.279s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:22:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:22:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:22:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:22:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:02 user nova-compute[73158]: INFO nova.compute.manager [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Detaching volume 8aa54f04-4f74-49ee-85bb-2cc5699db1dc
Aug 17 10:23:02 user nova-compute[73158]: INFO nova.virt.block_device [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Attempting to driver detach volume 8aa54f04-4f74-49ee-85bb-2cc5699db1dc from mountpoint /dev/vdb
Aug 17 10:23:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Attempting to detach device vdb from instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:23:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:23:02 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:02 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:23:02 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:23:02 user nova-compute[73158]:   <serial>8aa54f04-4f74-49ee-85bb-2cc5699db1dc</serial>
Aug 17 10:23:02 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:23:02 user nova-compute[73158]: </disk>
Aug 17 10:23:02 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:23:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully detached device vdb from instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc from the persistent domain config.
Aug 17 10:23:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:23:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:23:02 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:02 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:23:02 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:23:02 user nova-compute[73158]:   <serial>8aa54f04-4f74-49ee-85bb-2cc5699db1dc</serial>
Aug 17 10:23:02 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:23:02 user nova-compute[73158]: </disk>
Aug 17 10:23:02 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:23:03 user nova-compute[73158]: INFO nova.compute.manager [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Unrescuing
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267783.344186, ad8969a2-c443-4bba-b7d2-2b85a77e7bbc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:23:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully detached device vdb from instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc from the live domain config.
Aug 17 10:23:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFQSdpAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:03 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d4482-918d-4979-82e4-715b7b74c9b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd4187-bb07-4263-a681-ad9194302c36]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc7e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc'): ({'sdd'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Removing single pathed devices sdd {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99140af-6713-42d9-a24c-0396e2c349ce]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb65c5-11fa-4230-91d1-87a35cc5dc35]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flushing IO for device /dev/sdd {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1857290-b9f9-40cb-b8b9-699ad80ff2e0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87f4c5-0a5a-4f76-af87-edca6f826282]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3398ee-8ba9-4d91-8474-048cda7f5a8d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3689b0-82b9-423d-8d5b-51094755df59]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260]
Aug 17 10:23:03 user nova-compute[73158]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa54f04-4f74-49ee-85bb-2cc5699db1dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe421e4-5663-4063-aa35-aae28898758f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== disconnect_volume: return (321ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'flavor' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ffa0475-3232-4af5-a279-4e4ee2957e3a req-4ea56c6c-710c-4c0a-95db-34f68de25563 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ffa0475-3232-4af5-a279-4e4ee2957e3a req-4ea56c6c-710c-4c0a-95db-34f68de25563 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ffa0475-3232-4af5-a279-4e4ee2957e3a req-4ea56c6c-710c-4c0a-95db-34f68de25563 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ffa0475-3232-4af5-a279-4e4ee2957e3a req-4ea56c6c-710c-4c0a-95db-34f68de25563 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ffa0475-3232-4af5-a279-4e4ee2957e3a req-4ea56c6c-710c-4c0a-95db-34f68de25563 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:04 user nova-compute[73158]: WARNING nova.compute.manager [req-0ffa0475-3232-4af5-a279-4e4ee2957e3a req-4ea56c6c-710c-4c0a-95db-34f68de25563 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-927cbf45-a158-4bf4-a278-c9aec2405487 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.075s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance destroyed successfully.
Aug 17 10:23:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:06 user nova-compute[73158]: WARNING nova.compute.manager [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:06 user nova-compute[73158]: WARNING nova.compute.manager [req-ed606b95-a4e6-4382-8e44-ae26643bde09 req-3ae0e25e-0f81-414b-8988-debba93858e1 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for f8fbae4f-23df-44d8-99bc-992b84cf59ee due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267788.4690208, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Resumed (Lifecycle Event)
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c5b58e56-dd21-422b-b57a-42009ab9e7d4 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267788.469275, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Started (Lifecycle Event)
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-811af964-8699-461e-9383-95f68ad21ca0 req-36db1d27-6c53-4746-a53e-9d616fed3f07 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-811af964-8699-461e-9383-95f68ad21ca0 req-36db1d27-6c53-4746-a53e-9d616fed3f07 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-811af964-8699-461e-9383-95f68ad21ca0 req-36db1d27-6c53-4746-a53e-9d616fed3f07 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-811af964-8699-461e-9383-95f68ad21ca0 req-36db1d27-6c53-4746-a53e-9d616fed3f07 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-811af964-8699-461e-9383-95f68ad21ca0 req-36db1d27-6c53-4746-a53e-9d616fed3f07 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:08 user nova-compute[73158]: WARNING nova.compute.manager [req-811af964-8699-461e-9383-95f68ad21ca0 req-36db1d27-6c53-4746-a53e-9d616fed3f07 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state None.
Aug 17 10:23:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:11 user nova-compute[73158]: INFO nova.compute.manager [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Unrescuing
Aug 17 10:23:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:11 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'flavor' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-f95f7a9e-65d5-4dbf-b55d-199e14b42616 req-5489914e-de89-41f9-8c3d-5b03f8612023 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f95f7a9e-65d5-4dbf-b55d-199e14b42616 req-5489914e-de89-41f9-8c3d-5b03f8612023 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f95f7a9e-65d5-4dbf-b55d-199e14b42616 req-5489914e-de89-41f9-8c3d-5b03f8612023 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f95f7a9e-65d5-4dbf-b55d-199e14b42616 req-5489914e-de89-41f9-8c3d-5b03f8612023 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-f95f7a9e-65d5-4dbf-b55d-199e14b42616 req-5489914e-de89-41f9-8c3d-5b03f8612023 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:13 user nova-compute[73158]: WARNING nova.compute.manager [req-f95f7a9e-65d5-4dbf-b55d-199e14b42616 req-5489914e-de89-41f9-8c3d-5b03f8612023 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance destroyed successfully.
Aug 17 10:23:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:15 user nova-compute[73158]: WARNING nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing instance network info cache due to event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updated VIF entry in instance network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing instance network info cache due to event network-changed-ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Acquiring lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Acquired lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Refreshing network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updated VIF entry in instance network info cache for port ac4b8c1e-6806-40ab-990f-4686051d1286. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [{"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Releasing lock "refresh_cache-a3e106ed-a561-4519-bff8-a911f5e46d4b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:16 user nova-compute[73158]: WARNING nova.compute.manager [req-96792dea-e820-459b-a08f-568a1499e6f6 req-3e514282-07bc-4c38-b4c3-a159245deb56 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-7cc5ea0a-f4fb-4730-a042-d3fcaf50c40b req-68e355d5-74c3-4438-97af-8a9542e79985 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7cc5ea0a-f4fb-4730-a042-d3fcaf50c40b req-68e355d5-74c3-4438-97af-8a9542e79985 service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7cc5ea0a-f4fb-4730-a042-d3fcaf50c40b req-68e355d5-74c3-4438-97af-8a9542e79985 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7cc5ea0a-f4fb-4730-a042-d3fcaf50c40b req-68e355d5-74c3-4438-97af-8a9542e79985 service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-7cc5ea0a-f4fb-4730-a042-d3fcaf50c40b req-68e355d5-74c3-4438-97af-8a9542e79985 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:17 user nova-compute[73158]: WARNING nova.compute.manager [req-7cc5ea0a-f4fb-4730-a042-d3fcaf50c40b req-68e355d5-74c3-4438-97af-8a9542e79985 service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8142628a-ce36-4e2d-93a5-777636fa992c tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for a3e106ed-a561-4519-bff8-a911f5e46d4b due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267797.391261, a3e106ed-a561-4519-bff8-a911f5e46d4b => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:17 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Resumed (Lifecycle Event)
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:17 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267797.3915467, a3e106ed-a561-4519-bff8-a911f5e46d4b => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:17 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Started (Lifecycle Event)
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:23:21 user nova-compute[73158]: INFO nova.compute.claims [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Claim successful on node user
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:23:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:23:22 user nova-compute[73158]: INFO nova.virt.block_device [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Booting with volume a2c59f99-32ec-4481-a8d8-85031cc5dfef at /dev/vda
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.policy [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6db6c1120b74ffbb1bf354c509d27ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44597afe7d404702983ba1555116e936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG os_brick.utils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd09f8-426d-48b5-a79f-c39f5dafe246]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2788b728-96c4-43a5-bad0-ddca63a6cb9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd8e88-7e92-4904-b5dc-e66a25b7bfe4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f9ed6-4b9f-4ba4-b045-fe52f0a90d1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:23:22 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:23:22 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2f569-affe-4377-a385-708c05086155]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG os_brick.utils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:22 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating existing volume attachment record: 69284815-6a8d-48d7-9253-b0ebc2f6f133 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:23:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Successfully created port: 575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Successfully updated port: 575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquired lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-changed-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Refreshing instance network info cache due to event network-changed-575c37dd-5734-46db-9e11-58ff9dd0b1e0. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:23:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] Acquiring lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:23:25 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Releasing lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance network_info: |[{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:23:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] Acquired lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Refreshing network info cache for port 575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG nova.network.neutron [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updated VIF entry in instance network info cache for port 575c37dd-5734-46db-9e11-58ff9dd0b1e0. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG nova.network.neutron [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1dc235f2-b8a9-4520-bb39-c82ea578d902 req-76e6f180-c577-4f59-8557-1d6eab52bc7a service nova] Releasing lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Skipping network cache update for instance because it is Building. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:23:27 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquired lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.network.neutron [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'info_cache' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [{"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-ca69a434-ae39-4400-a07f-b49c41f99e84" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.network.neutron [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Releasing lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance destroyed successfully.
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'resources' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:28 user nova-compute[73158]: DEBUG os_vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4639473-b3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:29 user nova-compute[73158]: INFO os_vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3')
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:29 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4ee702-672b-4f96-b63d-389db0478d70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3fe7a-cdd7-4c52-99db-f7d8fc2040ff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc7e2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d2af99-56fe-4aeb-b21b-c134f3bcf17d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d363fd7-85bf-429a-95be-9915e44cf4b4]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82a4c6-e207-4ed3-82d0-cd6d333f48d5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.068s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0d5259-0dd9-4c46-a0e3-6c632e1c3703]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a52ec91-c7ac-4715-90bf-8a85e34bda14]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28d4c7a-923e-4e5c-8048-dabbfffe20d4]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]
Aug 17 10:23:29 user nova-compute[73158]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ce5c89-51a4-4b9b-a75a-d7d7830950e1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== disconnect_volume: return (453ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start _get_guest_xml network_info=[{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '04410e55-774d-4386-93f2-ad0006d860af', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a6744f73-a7ec-4388-8e15-c05068041a09', 'attached_at': '', 'detached_at': '', 'volume_id': '81bda531-49e8-45de-8ef6-a343c1e54216', 'serial': '81bda531-49e8-45de-8ef6-a343c1e54216'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'numa_topology' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:29 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:29 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:29 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:29 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[caddc5a4-b154-4840-b52b-ab684ac85d8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:23:29 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3852624-3ded-4d57-8772-f687dec6db24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216] added
Aug 17 10:23:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68252c1-8cdb-456f-b5c7-e1f7252f1a8e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fde8a5-66e9-4327-a64a-0e43713a9f40]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWQAOaoI {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWQAOaoI" returned: 0 in 0.038s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d12436-c3a0-4de5-90c4-b3a23beb2eb3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pWQAOaoI'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace3cb9-b721-4726-ad5a-76ff35059f1f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3b07b-627b-4d1c-9c23-9b6c7de4b03c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[657eca53-dd5e-40ab-b4d8-824339b3301b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]
Aug 17 10:23:30 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dc8c8f-6b4f-441c-82cb-dc22d0b07b8a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea3f6e-6ecb-47a5-9866-d70e5aea1938]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2204154b-5cc5-4394-97c8-29a3a944e5b9]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '26563376537383331', 'path': '/dev/sdd'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563376537383331', 'path': '/dev/sdd'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'pci_devices' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:23:31 user nova-compute[73158]:   <uuid>a6744f73-a7ec-4388-8e15-c05068041a09</uuid>
Aug 17 10:23:31 user nova-compute[73158]:   <name>instance-00000017</name>
Aug 17 10:23:31 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:23:31 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:23:31 user nova-compute[73158]:   <metadata>
Aug 17 10:23:31 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:23:31 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:23:31 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeTestJSON-server-1347333996</nova:name>
Aug 17 10:23:31 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:23:29</nova:creationTime>
Aug 17 10:23:31 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:23:31 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:23:31 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:23:31 user nova-compute[73158]:       <nova:owner>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:user uuid="1230fe2ff59346c7a312ef772820cab1">tempest-AttachVolumeTestJSON-1679631742-project-member</nova:user>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:project uuid="d6ec620087724665b6218bb575bfcbef">tempest-AttachVolumeTestJSON-1679631742</nova:project>
Aug 17 10:23:31 user nova-compute[73158]:       </nova:owner>
Aug 17 10:23:31 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:23:31 user nova-compute[73158]:       <nova:ports>
Aug 17 10:23:31 user nova-compute[73158]:         <nova:port uuid="e4639473-b396-4d8c-aadc-30d8e10252cb">
Aug 17 10:23:31 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:23:31 user nova-compute[73158]:         </nova:port>
Aug 17 10:23:31 user nova-compute[73158]:       </nova:ports>
Aug 17 10:23:31 user nova-compute[73158]:     </nova:instance>
Aug 17 10:23:31 user nova-compute[73158]:   </metadata>
Aug 17 10:23:31 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:23:31 user nova-compute[73158]:     <system>
Aug 17 10:23:31 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:23:31 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:23:31 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:23:31 user nova-compute[73158]:       <entry name="serial">a6744f73-a7ec-4388-8e15-c05068041a09</entry>
Aug 17 10:23:31 user nova-compute[73158]:       <entry name="uuid">a6744f73-a7ec-4388-8e15-c05068041a09</entry>
Aug 17 10:23:31 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:23:31 user nova-compute[73158]:     </system>
Aug 17 10:23:31 user nova-compute[73158]:   </sysinfo>
Aug 17 10:23:31 user nova-compute[73158]:   <os>
Aug 17 10:23:31 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:23:31 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:23:31 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:23:31 user nova-compute[73158]:   </os>
Aug 17 10:23:31 user nova-compute[73158]:   <features>
Aug 17 10:23:31 user nova-compute[73158]:     <acpi/>
Aug 17 10:23:31 user nova-compute[73158]:     <apic/>
Aug 17 10:23:31 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:23:31 user nova-compute[73158]:   </features>
Aug 17 10:23:31 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:23:31 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:23:31 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:23:31 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:23:31 user nova-compute[73158]:   </clock>
Aug 17 10:23:31 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:23:31 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:23:31 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:23:31 user nova-compute[73158]:   </cpu>
Aug 17 10:23:31 user nova-compute[73158]:   <devices>
Aug 17 10:23:31 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:23:31 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:23:31 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk"/>
Aug 17 10:23:31 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:23:31 user nova-compute[73158]:     </disk>
Aug 17 10:23:31 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:23:31 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:31 user nova-compute[73158]:       <source dev="/dev/sdd"/>
Aug 17 10:23:31 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:23:31 user nova-compute[73158]:       <serial>81bda531-49e8-45de-8ef6-a343c1e54216</serial>
Aug 17 10:23:31 user nova-compute[73158]:     </disk>
Aug 17 10:23:31 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:23:31 user nova-compute[73158]:       <mac address="fa:16:3e:c1:86:11"/>
Aug 17 10:23:31 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:31 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:23:31 user nova-compute[73158]:       <target dev="tape4639473-b3"/>
Aug 17 10:23:31 user nova-compute[73158]:     </interface>
Aug 17 10:23:31 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:23:31 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/console.log" append="off"/>
Aug 17 10:23:31 user nova-compute[73158]:     </serial>
Aug 17 10:23:31 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:23:31 user nova-compute[73158]:     <video>
Aug 17 10:23:31 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:31 user nova-compute[73158]:     </video>
Aug 17 10:23:31 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:23:31 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:23:31 user nova-compute[73158]:     </rng>
Aug 17 10:23:31 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:23:31 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:23:31 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:23:31 user nova-compute[73158]:     </memballoon>
Aug 17 10:23:31 user nova-compute[73158]:   </devices>
Aug 17 10:23:31 user nova-compute[73158]: </domain>
Aug 17 10:23:31 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.269s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Cannot resize image /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.objects.instance [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'migration_context' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG os_vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4639473-b3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4639473-b3, col_values=(('external_ids', {'iface-id': 'e4639473-b396-4d8c-aadc-30d8e10252cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:86:11', 'vm-uuid': 'a6744f73-a7ec-4388-8e15-c05068041a09'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:23:32 user nova-compute[73158]: INFO nova.compute.claims [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Claim successful on node user
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:32 user nova-compute[73158]: INFO os_vif [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3')
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:32 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.network.neutron [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:23:33 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.policy [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9e11c73731047a6990c618c2f7fe6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb69e4c9da4d2d9403e97e35033f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:23:33 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Creating image(s)
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "681aca725f5b459c4ee0e4d9aea161f1596e5cd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "681aca725f5b459c4ee0e4d9aea161f1596e5cd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.part --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.virt.images [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] 461989d1-6cc1-4277-a439-b06c387cdaa1 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.part /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.network.neutron [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Successfully created port: 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e3509b9-423c-4afc-bff9-1de5358ace65 req-3c72740d-15de-4e43-a758-fc38d1538ca3 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e3509b9-423c-4afc-bff9-1de5358ace65 req-3c72740d-15de-4e43-a758-fc38d1538ca3 service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e3509b9-423c-4afc-bff9-1de5358ace65 req-3c72740d-15de-4e43-a758-fc38d1538ca3 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e3509b9-423c-4afc-bff9-1de5358ace65 req-3c72740d-15de-4e43-a758-fc38d1538ca3 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e3509b9-423c-4afc-bff9-1de5358ace65 req-3c72740d-15de-4e43-a758-fc38d1538ca3 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:34 user nova-compute[73158]: WARNING nova.compute.manager [req-1e3509b9-423c-4afc-bff9-1de5358ace65 req-3c72740d-15de-4e43-a758-fc38d1538ca3 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state stopped and task_state powering-on.
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.part /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.converted" returned: 0 in 0.422s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "681aca725f5b459c4ee0e4d9aea161f1596e5cd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.351s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "681aca725f5b459c4ee0e4d9aea161f1596e5cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "681aca725f5b459c4ee0e4d9aea161f1596e5cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8,backing_fmt=raw /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8,backing_fmt=raw /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk 1073741824" returned: 0 in 0.086s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "681aca725f5b459c4ee0e4d9aea161f1596e5cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.network.neutron [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Successfully updated port: 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.compute.manager [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.compute.manager [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing instance network info cache due to event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.network.neutron [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.network.neutron [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Cannot resize image /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.objects.instance [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'migration_context' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Ensure instance console log exists: /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.network.neutron [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267816.1887178, a6744f73-a7ec-4388-8e15-c05068041a09 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Resumed (Lifecycle Event)
Aug 17 10:23:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-6eb4ef23-fdfa-4d99-a5cd-608b5ca22c24 req-2dd6133d-54e7-4c8c-97a5-d8ebbf43302c service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6eb4ef23-fdfa-4d99-a5cd-608b5ca22c24 req-2dd6133d-54e7-4c8c-97a5-d8ebbf43302c service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6eb4ef23-fdfa-4d99-a5cd-608b5ca22c24 req-2dd6133d-54e7-4c8c-97a5-d8ebbf43302c service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6eb4ef23-fdfa-4d99-a5cd-608b5ca22c24 req-2dd6133d-54e7-4c8c-97a5-d8ebbf43302c service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-6eb4ef23-fdfa-4d99-a5cd-608b5ca22c24 req-2dd6133d-54e7-4c8c-97a5-d8ebbf43302c service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:36 user nova-compute[73158]: WARNING nova.compute.manager [req-6eb4ef23-fdfa-4d99-a5cd-608b5ca22c24 req-2dd6133d-54e7-4c8c-97a5-d8ebbf43302c service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state stopped and task_state powering-on.
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ef7823cf-3db4-40f8-8793-5994178542b7 req-816febea-5cde-4a70-acd6-85eee9282014 service nova] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.network.neutron [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance rebooted successfully.
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-49631436-8b75-41fe-98ca-b8750f484073 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7164MB free_disk=23.980518341064453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267816.1893408, a6744f73-a7ec-4388-8e15-c05068041a09 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Started (Lifecycle Event)
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.network.neutron [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:23:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Creating image(s)
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Ensure instance console log exists: /opt/stack/data/nova/instances/008cc48e-5db1-4f5d-b133-e9577cabe4f8/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Start _get_guest_xml network_info=[{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '69284815-6a8d-48d7-9253-b0ebc2f6f133', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '008cc48e-5db1-4f5d-b133-e9577cabe4f8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2c59f99-32ec-4481-a8d8-85031cc5dfef', 'serial': 'a2c59f99-32ec-4481-a8d8-85031cc5dfef'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Applying migration context for instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee as it has an incoming, in-progress migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0. Migration status is reverting {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 10:23:36 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating resource usage from migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0
Aug 17 10:23:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:36 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:36 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:36 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 19672aa4-812e-4a2f-8d96-002fa79b708f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9dbf99-50d9-4118-ad02-4706af720515]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:23:36 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.network.neutron [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Port 94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 binding to destination host user is already ACTIVE {{(pid=73158) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG nova.network.neutron [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[70846f5f-5cc4-4638-85e0-b58cbeadf82f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef] added
Aug 17 10:23:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9561d2-1fea-48a3-999e-2c3890425c77]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb03c8d-36d2-4c30-9580-428ea1395f26]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFenDGUz {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFenDGUz" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd975c-282d-460a-823a-4859dea1bfe3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFenDGUz'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6e2eb6-c941-4215-a5ce-dac024b2a707]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505cb95-1dc8-4313-adb4-bba990d9f41d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96dfe6e-a8ff-4a64-ba43-da995869eb31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]
Aug 17 10:23:37 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4ced31-5cfc-44e5-b452-53e494eca5f1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb64f31-4540-4736-809e-1d3a20dbf810]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:37 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:37 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd120499-769e-4192-8103-8adcaac2e00d]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance network_info: |[{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Start _get_guest_xml network_info=[{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:23:28Z,direct_url=<?>,disk_format='qcow2',id=461989d1-6cc1-4277-a439-b06c387cdaa1,min_disk=0,min_ram=0,name='tempest-scenario-img--2023401532',owner='beeb69e4c9da4d2d9403e97e35033f1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:23:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '461989d1-6cc1-4277-a439-b06c387cdaa1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:37 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:23:28Z,direct_url=<?>,disk_format='qcow2',id=461989d1-6cc1-4277-a439-b06c387cdaa1,min_disk=0,min_ram=0,name='tempest-scenario-img--2023401532',owner='beeb69e4c9da4d2d9403e97e35033f1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:23:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-587024482',display_name='tempest-TestMinimumBasicScenario-server-587024482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-587024482',id=29,image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8FVbmx+kb9yEUO9ShiA8PDyvF3awL3M5GGHQMeJ6cvLiCiq2GvBkb4I6zdhk86CKHLLxrbVf+Xuafinn96NHTuiqljroLITC4F5jmg4zNK93DW3UdMVk4mp66Y2ngJpQ==',key_name='tempest-TestMinimumBasicScenario-252178196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-p22xgs3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:23:33Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=18c69e67-2459-4e44-b6cb-0321b02259a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'pci_devices' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:23:37 user nova-compute[73158]:   <uuid>18c69e67-2459-4e44-b6cb-0321b02259a3</uuid>
Aug 17 10:23:37 user nova-compute[73158]:   <name>instance-0000001d</name>
Aug 17 10:23:37 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:23:37 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:23:37 user nova-compute[73158]:   <metadata>
Aug 17 10:23:37 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:23:37 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:23:37 user nova-compute[73158]:       <nova:name>tempest-TestMinimumBasicScenario-server-587024482</nova:name>
Aug 17 10:23:37 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:23:37</nova:creationTime>
Aug 17 10:23:37 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:23:37 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:23:37 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:23:37 user nova-compute[73158]:       <nova:owner>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:user uuid="b9e11c73731047a6990c618c2f7fe6a2">tempest-TestMinimumBasicScenario-1702191441-project-member</nova:user>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:project uuid="beeb69e4c9da4d2d9403e97e35033f1a">tempest-TestMinimumBasicScenario-1702191441</nova:project>
Aug 17 10:23:37 user nova-compute[73158]:       </nova:owner>
Aug 17 10:23:37 user nova-compute[73158]:       <nova:root type="image" uuid="461989d1-6cc1-4277-a439-b06c387cdaa1"/>
Aug 17 10:23:37 user nova-compute[73158]:       <nova:ports>
Aug 17 10:23:37 user nova-compute[73158]:         <nova:port uuid="00e0222d-048b-4880-a9e1-0c4dec6749e8">
Aug 17 10:23:37 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:23:37 user nova-compute[73158]:         </nova:port>
Aug 17 10:23:37 user nova-compute[73158]:       </nova:ports>
Aug 17 10:23:37 user nova-compute[73158]:     </nova:instance>
Aug 17 10:23:37 user nova-compute[73158]:   </metadata>
Aug 17 10:23:37 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:23:37 user nova-compute[73158]:     <system>
Aug 17 10:23:37 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:23:37 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:23:37 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:23:37 user nova-compute[73158]:       <entry name="serial">18c69e67-2459-4e44-b6cb-0321b02259a3</entry>
Aug 17 10:23:37 user nova-compute[73158]:       <entry name="uuid">18c69e67-2459-4e44-b6cb-0321b02259a3</entry>
Aug 17 10:23:37 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:23:37 user nova-compute[73158]:     </system>
Aug 17 10:23:37 user nova-compute[73158]:   </sysinfo>
Aug 17 10:23:37 user nova-compute[73158]:   <os>
Aug 17 10:23:37 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:23:37 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:23:37 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:23:37 user nova-compute[73158]:   </os>
Aug 17 10:23:37 user nova-compute[73158]:   <features>
Aug 17 10:23:37 user nova-compute[73158]:     <acpi/>
Aug 17 10:23:37 user nova-compute[73158]:     <apic/>
Aug 17 10:23:37 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:23:37 user nova-compute[73158]:   </features>
Aug 17 10:23:37 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:23:37 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:23:37 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:23:37 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:23:37 user nova-compute[73158]:   </clock>
Aug 17 10:23:37 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:23:37 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:23:37 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:23:37 user nova-compute[73158]:   </cpu>
Aug 17 10:23:37 user nova-compute[73158]:   <devices>
Aug 17 10:23:37 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:23:37 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:23:37 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk"/>
Aug 17 10:23:37 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:23:37 user nova-compute[73158]:     </disk>
Aug 17 10:23:37 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:23:37 user nova-compute[73158]:       <mac address="fa:16:3e:6e:1d:71"/>
Aug 17 10:23:37 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:37 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:23:37 user nova-compute[73158]:       <target dev="tap00e0222d-04"/>
Aug 17 10:23:37 user nova-compute[73158]:     </interface>
Aug 17 10:23:37 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:23:37 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/console.log" append="off"/>
Aug 17 10:23:37 user nova-compute[73158]:     </serial>
Aug 17 10:23:37 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:23:37 user nova-compute[73158]:     <video>
Aug 17 10:23:37 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:37 user nova-compute[73158]:     </video>
Aug 17 10:23:37 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:23:37 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:23:37 user nova-compute[73158]:     </rng>
Aug 17 10:23:37 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:23:37 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:23:37 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:23:37 user nova-compute[73158]:     </memballoon>
Aug 17 10:23:37 user nova-compute[73158]:   </devices>
Aug 17 10:23:37 user nova-compute[73158]: </domain>
Aug 17 10:23:37 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-587024482',display_name='tempest-TestMinimumBasicScenario-server-587024482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-587024482',id=29,image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8FVbmx+kb9yEUO9ShiA8PDyvF3awL3M5GGHQMeJ6cvLiCiq2GvBkb4I6zdhk86CKHLLxrbVf+Xuafinn96NHTuiqljroLITC4F5jmg4zNK93DW3UdMVk4mp66Y2ngJpQ==',key_name='tempest-TestMinimumBasicScenario-252178196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-p22xgs3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:23:33Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=18c69e67-2459-4e44-b6cb-0321b02259a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG os_vif [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00e0222d-04, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00e0222d-04, col_values=(('external_ids', {'iface-id': '00e0222d-048b-4880-a9e1-0c4dec6749e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1d:71', 'vm-uuid': '18c69e67-2459-4e44-b6cb-0321b02259a3'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: INFO os_vif [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04')
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.874s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No VIF found with MAC fa:16:3e:6e:1d:71, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Creating tmpfile /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/tmpva_76dlh to verify with other compute node that the instance is on the same shared storage. {{(pid=73158) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23231656635363231', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231656635363231', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-45769809-2991-414a-a4e0-458e854383e5 req-b8dccd20-5b97-4203-97a8-18ae66cfd60b service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-45769809-2991-414a-a4e0-458e854383e5 req-b8dccd20-5b97-4203-97a8-18ae66cfd60b service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-45769809-2991-414a-a4e0-458e854383e5 req-b8dccd20-5b97-4203-97a8-18ae66cfd60b service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-45769809-2991-414a-a4e0-458e854383e5 req-b8dccd20-5b97-4203-97a8-18ae66cfd60b service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-45769809-2991-414a-a4e0-458e854383e5 req-b8dccd20-5b97-4203-97a8-18ae66cfd60b service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:38 user nova-compute[73158]: WARNING nova.compute.manager [req-45769809-2991-414a-a4e0-458e854383e5 req-b8dccd20-5b97-4203-97a8-18ae66cfd60b service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state resized and task_state resize_reverting.
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-796905679',display_name='tempest-ServerActionsTestOtherA-server-796905679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-796905679',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-5t2q7aa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=008cc48e-5db1-4f5d-b133-e9577cabe4f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_devices' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:23:38 user nova-compute[73158]:   <uuid>008cc48e-5db1-4f5d-b133-e9577cabe4f8</uuid>
Aug 17 10:23:38 user nova-compute[73158]:   <name>instance-0000001c</name>
Aug 17 10:23:38 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:23:38 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:23:38 user nova-compute[73158]:   <metadata>
Aug 17 10:23:38 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:23:38 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:23:38 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherA-server-796905679</nova:name>
Aug 17 10:23:38 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:23:36</nova:creationTime>
Aug 17 10:23:38 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:23:38 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:23:38 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:23:38 user nova-compute[73158]:       <nova:owner>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:user uuid="a6db6c1120b74ffbb1bf354c509d27ec">tempest-ServerActionsTestOtherA-1163059526-project-member</nova:user>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:project uuid="44597afe7d404702983ba1555116e936">tempest-ServerActionsTestOtherA-1163059526</nova:project>
Aug 17 10:23:38 user nova-compute[73158]:       </nova:owner>
Aug 17 10:23:38 user nova-compute[73158]:       <nova:ports>
Aug 17 10:23:38 user nova-compute[73158]:         <nova:port uuid="575c37dd-5734-46db-9e11-58ff9dd0b1e0">
Aug 17 10:23:38 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:23:38 user nova-compute[73158]:         </nova:port>
Aug 17 10:23:38 user nova-compute[73158]:       </nova:ports>
Aug 17 10:23:38 user nova-compute[73158]:     </nova:instance>
Aug 17 10:23:38 user nova-compute[73158]:   </metadata>
Aug 17 10:23:38 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:23:38 user nova-compute[73158]:     <system>
Aug 17 10:23:38 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:23:38 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:23:38 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:23:38 user nova-compute[73158]:       <entry name="serial">008cc48e-5db1-4f5d-b133-e9577cabe4f8</entry>
Aug 17 10:23:38 user nova-compute[73158]:       <entry name="uuid">008cc48e-5db1-4f5d-b133-e9577cabe4f8</entry>
Aug 17 10:23:38 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:23:38 user nova-compute[73158]:     </system>
Aug 17 10:23:38 user nova-compute[73158]:   </sysinfo>
Aug 17 10:23:38 user nova-compute[73158]:   <os>
Aug 17 10:23:38 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:23:38 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:23:38 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:23:38 user nova-compute[73158]:   </os>
Aug 17 10:23:38 user nova-compute[73158]:   <features>
Aug 17 10:23:38 user nova-compute[73158]:     <acpi/>
Aug 17 10:23:38 user nova-compute[73158]:     <apic/>
Aug 17 10:23:38 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:23:38 user nova-compute[73158]:   </features>
Aug 17 10:23:38 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:23:38 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:23:38 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:23:38 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:23:38 user nova-compute[73158]:   </clock>
Aug 17 10:23:38 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:23:38 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:23:38 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:23:38 user nova-compute[73158]:   </cpu>
Aug 17 10:23:38 user nova-compute[73158]:   <devices>
Aug 17 10:23:38 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:23:38 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:38 user nova-compute[73158]:       <source dev="/dev/sdf"/>
Aug 17 10:23:38 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:23:38 user nova-compute[73158]:       <serial>a2c59f99-32ec-4481-a8d8-85031cc5dfef</serial>
Aug 17 10:23:38 user nova-compute[73158]:     </disk>
Aug 17 10:23:38 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:23:38 user nova-compute[73158]:       <mac address="fa:16:3e:58:e0:cd"/>
Aug 17 10:23:38 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:38 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:23:38 user nova-compute[73158]:       <target dev="tap575c37dd-57"/>
Aug 17 10:23:38 user nova-compute[73158]:     </interface>
Aug 17 10:23:38 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:23:38 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/008cc48e-5db1-4f5d-b133-e9577cabe4f8/console.log" append="off"/>
Aug 17 10:23:38 user nova-compute[73158]:     </serial>
Aug 17 10:23:38 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:23:38 user nova-compute[73158]:     <video>
Aug 17 10:23:38 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:38 user nova-compute[73158]:     </video>
Aug 17 10:23:38 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:23:38 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:23:38 user nova-compute[73158]:     </rng>
Aug 17 10:23:38 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:23:38 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:23:38 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:23:38 user nova-compute[73158]:     </memballoon>
Aug 17 10:23:38 user nova-compute[73158]:   </devices>
Aug 17 10:23:38 user nova-compute[73158]: </domain>
Aug 17 10:23:38 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-796905679',display_name='tempest-ServerActionsTestOtherA-server-796905679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-796905679',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-5t2q7aa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=008cc48e-5db1-4f5d-b133-e9577cabe4f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG os_vif [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap575c37dd-57, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap575c37dd-57, col_values=(('external_ids', {'iface-id': '575c37dd-5734-46db-9e11-58ff9dd0b1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:e0:cd', 'vm-uuid': '008cc48e-5db1-4f5d-b133-e9577cabe4f8'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:38 user nova-compute[73158]: INFO os_vif [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57')
Aug 17 10:23:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:23:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No VIF found with MAC fa:16:3e:58:e0:cd, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:23:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance destroyed successfully.
Aug 17 10:23:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'resources' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG os_vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94d3ea77-5e, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: INFO os_vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e')
Aug 17 10:23:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bb9d9b-a532-4fe1-b7a4-e9e90b0deded]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8719d611-a42e-4b8d-ad28-c0e01a880518]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:40 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'): ({'sdg'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Removing single pathed devices sdg {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ec5f6-faba-4633-a839-d50a25952f41]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a77b9-9ae4-4276-8de9-ef35388cb7b9]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flushing IO for device /dev/sdg {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3184a53-0b80-4add-be6e-69ebd21bc26b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e929a2d3-50d9-421f-a27b-e60b6decdab7]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd7df4-62ef-4a67-8a65-6be514ffbb9a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcea4136-9978-4d38-894d-aa7ed121b918]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]
Aug 17 10:23:40 user nova-compute[73158]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c48d0-04e4-4a3d-a72f-8e8559a01cf9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== disconnect_volume: return (323ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-c790c323-5e8e-405b-a9fb-64956a1fb6e7 req-50e64c31-cbfc-46cf-b30d-078c0d4ededb service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c790c323-5e8e-405b-a9fb-64956a1fb6e7 req-50e64c31-cbfc-46cf-b30d-078c0d4ededb service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c790c323-5e8e-405b-a9fb-64956a1fb6e7 req-50e64c31-cbfc-46cf-b30d-078c0d4ededb service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c790c323-5e8e-405b-a9fb-64956a1fb6e7 req-50e64c31-cbfc-46cf-b30d-078c0d4ededb service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-c790c323-5e8e-405b-a9fb-64956a1fb6e7 req-50e64c31-cbfc-46cf-b30d-078c0d4ededb service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:40 user nova-compute[73158]: WARNING nova.compute.manager [req-c790c323-5e8e-405b-a9fb-64956a1fb6e7 req-50e64c31-cbfc-46cf-b30d-078c0d4ededb service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state resized and task_state resize_reverting.
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG nova.objects.instance [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'migration_context' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-569f2827-72b8-4c19-b2c8-6a2f32d5bd36 req-52ff10a9-0405-4ad2-867c-eda1662e61d0 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-569f2827-72b8-4c19-b2c8-6a2f32d5bd36 req-52ff10a9-0405-4ad2-867c-eda1662e61d0 service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-569f2827-72b8-4c19-b2c8-6a2f32d5bd36 req-52ff10a9-0405-4ad2-867c-eda1662e61d0 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-569f2827-72b8-4c19-b2c8-6a2f32d5bd36 req-52ff10a9-0405-4ad2-867c-eda1662e61d0 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-569f2827-72b8-4c19-b2c8-6a2f32d5bd36 req-52ff10a9-0405-4ad2-867c-eda1662e61d0 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:41 user nova-compute[73158]: WARNING nova.compute.manager [req-569f2827-72b8-4c19-b2c8-6a2f32d5bd36 req-52ff10a9-0405-4ad2-867c-eda1662e61d0 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state building and task_state spawning.
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.620s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:42 user nova-compute[73158]: INFO nova.compute.manager [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Swapping old allocation on dict_keys(['6683a228-d116-40aa-bd44-73677ce911ae']) held by migration 6d9f258f-c5e2-48f9-88c7-4f06066b75d0 for instance
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Overwriting current allocation {'allocations': {'6683a228-d116-40aa-bd44-73677ce911ae': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 33}}, 'project_id': '9b7160dba7264083b524295f3d5028e8', 'user_id': 'd3434dc3b8af4c6dae565ddeb206e201', 'consumer_generation': 1} on consumer 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:42 user nova-compute[73158]: WARNING nova.compute.manager [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state building and task_state spawning.
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.compute.manager [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:42 user nova-compute[73158]: WARNING nova.compute.manager [req-72f7d297-add1-4e33-973c-6a42fc1a3919 req-ee2f5684-f917-4aa0-9eb5-8881be65982e service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state building and task_state spawning.
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquired lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Releasing lock "refresh_cache-4fe9c190-01f0-4d1c-af66-cd61aa8334ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG os_brick.utils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[af544df6-c10f-4f20-9ef5-45d7920c2aa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[587ee7f4-c9f8-40e9-958d-30452310b706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f56ed-4dfd-4a63-9c40-382db0d7f225]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a1853-ce2e-4f64-aaa6-a7822cc204f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:23:43 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee9e394-80c1-4d05-9c1a-1ea4f744cb64]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG os_brick.utils [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267823.3194344, 008cc48e-5db1-4f5d-b133-e9577cabe4f8 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] VM Resumed (Lifecycle Event)
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance spawned successfully.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance spawned successfully.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267823.3260326, 008cc48e-5db1-4f5d-b133-e9577cabe4f8 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] VM Started (Lifecycle Event)
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267823.3345141, 18c69e67-2459-4e44-b6cb-0321b02259a3 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] VM Resumed (Lifecycle Event)
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Took 10.18 seconds to spawn the instance on the hypervisor.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267823.3460824, 18c69e67-2459-4e44-b6cb-0321b02259a3 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] VM Started (Lifecycle Event)
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Took 11.30 seconds to build instance.
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:23:43 user nova-compute[73158]: INFO nova.compute.manager [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Took 21.80 seconds to build instance.
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-092a1247-3428-416d-85a4-a129ecd00216 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.484s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0d6bdaeb-4536-4905-a1b1-b9b304ad86e3 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.899s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6e73d2b-b0ec-404c-b73b-c92786927a54 req-445f2fbd-612b-4aa4-b82a-85195c25e75f service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6e73d2b-b0ec-404c-b73b-c92786927a54 req-445f2fbd-612b-4aa4-b82a-85195c25e75f service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6e73d2b-b0ec-404c-b73b-c92786927a54 req-445f2fbd-612b-4aa4-b82a-85195c25e75f service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6e73d2b-b0ec-404c-b73b-c92786927a54 req-445f2fbd-612b-4aa4-b82a-85195c25e75f service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6e73d2b-b0ec-404c-b73b-c92786927a54 req-445f2fbd-612b-4aa4-b82a-85195c25e75f service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:43 user nova-compute[73158]: WARNING nova.compute.manager [req-f6e73d2b-b0ec-404c-b73b-c92786927a54 req-445f2fbd-612b-4aa4-b82a-85195c25e75f service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state active and task_state None.
Aug 17 10:23:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:45 user nova-compute[73158]: INFO nova.compute.manager [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Detaching volume 46720a89-362f-4ba1-b1f1-ec2c198aa525
Aug 17 10:23:46 user nova-compute[73158]: INFO nova.virt.block_device [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Attempting to driver detach volume 46720a89-362f-4ba1-b1f1-ec2c198aa525 from mountpoint /dev/vdb
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Attempting to detach device vdb from instance a3e106ed-a561-4519-bff8-a911f5e46d4b from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:23:46 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:46 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:23:46 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:23:46 user nova-compute[73158]:   <serial>46720a89-362f-4ba1-b1f1-ec2c198aa525</serial>
Aug 17 10:23:46 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:23:46 user nova-compute[73158]: </disk>
Aug 17 10:23:46 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:23:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Successfully detached device vdb from instance a3e106ed-a561-4519-bff8-a911f5e46d4b from the persistent domain config.
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3e106ed-a561-4519-bff8-a911f5e46d4b from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:23:46 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:46 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:23:46 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:23:46 user nova-compute[73158]:   <serial>46720a89-362f-4ba1-b1f1-ec2c198aa525</serial>
Aug 17 10:23:46 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:23:46 user nova-compute[73158]: </disk>
Aug 17 10:23:46 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267826.502796, a3e106ed-a561-4519-bff8-a911f5e46d4b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:23:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Successfully detached device vdb from instance a3e106ed-a561-4519-bff8-a911f5e46d4b from the live domain config.
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KduBTeJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:46 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a3e89-382a-4056-a455-ee9790d2b39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ed6d5-28b6-4dc1-8b2f-9e26a1427cfe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:46 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c2cb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[625e56ed-7393-4c4c-b773-4c90713efc4a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f2173c-6815-4507-99df-ade83ccb6381]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf26ab-96a2-4c7c-bbc7-c35826c71881]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a63b4eb-cdb7-4279-bac4-ca6e3f09b85b]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eda324-d1a2-4775-8c7c-c9b5b4e8d1b4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e755b9e1-4607-46da-b7ef-01561a60556c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260]
Aug 17 10:23:46 user nova-compute[73158]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46720a89-362f-4ba1-b1f1-ec2c198aa525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ac0f31-6c06-483c-acaf-c3b0969132b0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] <== disconnect_volume: return (331ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:23:47 user nova-compute[73158]: DEBUG nova.objects.instance [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'flavor' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-adfd17eb-ee52-41cf-9a82-b486e966a364 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.953s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:53 user nova-compute[73158]: INFO nova.compute.manager [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Terminating instance
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-c5bc1d60-6816-4d8f-956e-aa1780327fa6 req-d6983fea-689a-40e2-8424-7d527768b2ce service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-vif-unplugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c5bc1d60-6816-4d8f-956e-aa1780327fa6 req-d6983fea-689a-40e2-8424-7d527768b2ce service nova] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c5bc1d60-6816-4d8f-956e-aa1780327fa6 req-d6983fea-689a-40e2-8424-7d527768b2ce service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c5bc1d60-6816-4d8f-956e-aa1780327fa6 req-d6983fea-689a-40e2-8424-7d527768b2ce service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-c5bc1d60-6816-4d8f-956e-aa1780327fa6 req-d6983fea-689a-40e2-8424-7d527768b2ce service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] No waiting events found dispatching network-vif-unplugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-c5bc1d60-6816-4d8f-956e-aa1780327fa6 req-d6983fea-689a-40e2-8424-7d527768b2ce service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-vif-unplugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:23:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Instance destroyed successfully.
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'resources' on Instance uuid ad8969a2-c443-4bba-b7d2-2b85a77e7bbc {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451338262',display_name='tempest-AttachVolumeNegativeTest-server-451338262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451338262',id=20,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdY4wgra98gyHuGpUEJWdUqnayXeHto8P1zE7Rq3CiMHI9Yt+N2hAFk2shNP8FqUVJttqNHPVPA6kmZrTjVfKCIrg19ilb8AnkW5YKhmd9i4MfQyEV/cIJXx7dCRZ+FJg==',key_name='tempest-keypair-1209704172',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-snsmakn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=ad8969a2-c443-4bba-b7d2-2b85a77e7bbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "address": "fa:16:3e:85:df:1c", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548c5ca8-8c", "ovs_interfaceid": "548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG os_vif [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap548c5ca8-8c, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:53 user nova-compute[73158]: INFO os_vif [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:df:1c,bridge_name='br-int',has_traffic_filtering=True,id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548c5ca8-8c')
Aug 17 10:23:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Deleting instance files /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc_del
Aug 17 10:23:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Deletion of /opt/stack/data/nova/instances/ad8969a2-c443-4bba-b7d2-2b85a77e7bbc_del complete
Aug 17 10:23:53 user nova-compute[73158]: INFO nova.compute.manager [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 10:23:53 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:23:53 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:23:54 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267819.9534502, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:23:54 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Stopped (Lifecycle Event)
Aug 17 10:23:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3791faf3-22f4-448a-9827-1844913eb610 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Starting finish_revert_migration {{(pid=73158) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start _get_guest_xml network_info=[{"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': 'f539d784-87ce-4714-9063-5ac818bf1c15', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4fe9c190-01f0-4d1c-af66-cd61aa8334ee', 'attached_at': '2023-08-17T10:23:55.000000', 'detached_at': '', 'volume_id': '3474c7db-e686-4c34-9bd5-1ac0f576fd31', 'serial': '3474c7db-e686-4c34-9bd5-1ac0f576fd31'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:23:55 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:55 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.objects.instance [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:23:55 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:55 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:23:55 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d48a8c-6f71-48fc-b95f-6b2e48e714cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:23:55 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d2684-42e0-41bf-b978-040fe22a0118]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31] added
Aug 17 10:23:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc9e2e-5d30-4ea4-b0ca-d011325d7b64]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee78782-7513-4698-8301-6ea8e92ed750]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebjOowFy {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebjOowFy" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fc51e-3479-423d-90c4-6a27c819b0ee]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ebjOowFy'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e4c552-21e5-4b77-98f5-e582af6dc484]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355296e-9881-4f6b-acd2-006a0c49258c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-20360f55-cd70-4937-bf01-8e976d2c4504 req-7d1e9a02-c49d-4f61-adae-a286763d8a57 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-20360f55-cd70-4937-bf01-8e976d2c4504 req-7d1e9a02-c49d-4f61-adae-a286763d8a57 service nova] Acquiring lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-20360f55-cd70-4937-bf01-8e976d2c4504 req-7d1e9a02-c49d-4f61-adae-a286763d8a57 service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-20360f55-cd70-4937-bf01-8e976d2c4504 req-7d1e9a02-c49d-4f61-adae-a286763d8a57 service nova] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-20360f55-cd70-4937-bf01-8e976d2c4504 req-7d1e9a02-c49d-4f61-adae-a286763d8a57 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] No waiting events found dispatching network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:55 user nova-compute[73158]: WARNING nova.compute.manager [req-20360f55-cd70-4937-bf01-8e976d2c4504 req-7d1e9a02-c49d-4f61-adae-a286763d8a57 service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received unexpected event network-vif-plugged-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 for instance with vm_state active and task_state deleting.
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f87fc-8bbc-48f6-adc3-bd4bad90059b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]
Aug 17 10:23:55 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.
Aug 17 10:23:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Took 1.53 seconds to deallocate network for instance.
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-8a462afd-b446-4f17-8cb0-bcfbf8b981dd req-e3ff0923-0f61-42c0-b631-f3eab340a2af service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Received event network-vif-deleted-548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:55 user nova-compute[73158]: INFO nova.compute.manager [req-8a462afd-b446-4f17-8cb0-bcfbf8b981dd req-e3ff0923-0f61-42c0-b631-f3eab340a2af service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Neutron deleted interface 548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6; detaching it from the instance and deleting it from the info cache
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.network.neutron [req-8a462afd-b446-4f17-8cb0-bcfbf8b981dd req-e3ff0923-0f61-42c0-b631-f3eab340a2af service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0baf90-3067-4229-b236-fe314e825911]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-8a462afd-b446-4f17-8cb0-bcfbf8b981dd req-e3ff0923-0f61-42c0-b631-f3eab340a2af service nova] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Detach interface failed, port_id=548c5ca8-8c7c-4a6a-8ed7-5ed9b18d02e6, reason: Instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59aaea-b3e3-4210-a719-17ebce70a479]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:23:55 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:23:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc4b02e-f58f-4c71-8a18-e08e9558ead9]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:55 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Deleted allocations for instance ad8969a2-c443-4bba-b7d2-2b85a77e7bbc
Aug 17 10:23:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1657cdc9-8f42-466d-8e24-c5bca82c6ae2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "ad8969a2-c443-4bba-b7d2-2b85a77e7bbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.984s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23630613233333635', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630613233333635', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:23:56 user nova-compute[73158]:   <uuid>4fe9c190-01f0-4d1c-af66-cd61aa8334ee</uuid>
Aug 17 10:23:56 user nova-compute[73158]:   <name>instance-00000013</name>
Aug 17 10:23:56 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:23:56 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:23:56 user nova-compute[73158]:   <metadata>
Aug 17 10:23:56 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:23:56 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:23:56 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherB-server-1669003801</nova:name>
Aug 17 10:23:56 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:23:55</nova:creationTime>
Aug 17 10:23:56 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:23:56 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:23:56 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:23:56 user nova-compute[73158]:       <nova:owner>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:user uuid="d3434dc3b8af4c6dae565ddeb206e201">tempest-ServerActionsTestOtherB-1114975532-project-member</nova:user>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:project uuid="9b7160dba7264083b524295f3d5028e8">tempest-ServerActionsTestOtherB-1114975532</nova:project>
Aug 17 10:23:56 user nova-compute[73158]:       </nova:owner>
Aug 17 10:23:56 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:23:56 user nova-compute[73158]:       <nova:ports>
Aug 17 10:23:56 user nova-compute[73158]:         <nova:port uuid="94d3ea77-5eb2-4eaf-b0e8-150394cce1a2">
Aug 17 10:23:56 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:23:56 user nova-compute[73158]:         </nova:port>
Aug 17 10:23:56 user nova-compute[73158]:       </nova:ports>
Aug 17 10:23:56 user nova-compute[73158]:     </nova:instance>
Aug 17 10:23:56 user nova-compute[73158]:   </metadata>
Aug 17 10:23:56 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:23:56 user nova-compute[73158]:     <system>
Aug 17 10:23:56 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:23:56 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:23:56 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:23:56 user nova-compute[73158]:       <entry name="serial">4fe9c190-01f0-4d1c-af66-cd61aa8334ee</entry>
Aug 17 10:23:56 user nova-compute[73158]:       <entry name="uuid">4fe9c190-01f0-4d1c-af66-cd61aa8334ee</entry>
Aug 17 10:23:56 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:23:56 user nova-compute[73158]:     </system>
Aug 17 10:23:56 user nova-compute[73158]:   </sysinfo>
Aug 17 10:23:56 user nova-compute[73158]:   <os>
Aug 17 10:23:56 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:23:56 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:23:56 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:23:56 user nova-compute[73158]:   </os>
Aug 17 10:23:56 user nova-compute[73158]:   <features>
Aug 17 10:23:56 user nova-compute[73158]:     <acpi/>
Aug 17 10:23:56 user nova-compute[73158]:     <apic/>
Aug 17 10:23:56 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:23:56 user nova-compute[73158]:   </features>
Aug 17 10:23:56 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:23:56 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:23:56 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:23:56 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:23:56 user nova-compute[73158]:   </clock>
Aug 17 10:23:56 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:23:56 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:23:56 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:23:56 user nova-compute[73158]:   </cpu>
Aug 17 10:23:56 user nova-compute[73158]:   <devices>
Aug 17 10:23:56 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:23:56 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:23:56 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk"/>
Aug 17 10:23:56 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:23:56 user nova-compute[73158]:     </disk>
Aug 17 10:23:56 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:23:56 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:23:56 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:23:56 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:23:56 user nova-compute[73158]:       <serial>3474c7db-e686-4c34-9bd5-1ac0f576fd31</serial>
Aug 17 10:23:56 user nova-compute[73158]:     </disk>
Aug 17 10:23:56 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:23:56 user nova-compute[73158]:       <mac address="fa:16:3e:80:1e:65"/>
Aug 17 10:23:56 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:56 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:23:56 user nova-compute[73158]:       <target dev="tap94d3ea77-5e"/>
Aug 17 10:23:56 user nova-compute[73158]:     </interface>
Aug 17 10:23:56 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:23:56 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/console.log" append="off"/>
Aug 17 10:23:56 user nova-compute[73158]:     </serial>
Aug 17 10:23:56 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:23:56 user nova-compute[73158]:     <video>
Aug 17 10:23:56 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:23:56 user nova-compute[73158]:     </video>
Aug 17 10:23:56 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:23:56 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:23:56 user nova-compute[73158]:     </rng>
Aug 17 10:23:56 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:23:56 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:23:56 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:23:56 user nova-compute[73158]:     </memballoon>
Aug 17 10:23:56 user nova-compute[73158]:   </devices>
Aug 17 10:23:56 user nova-compute[73158]: </domain>
Aug 17 10:23:56 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG os_vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94d3ea77-5e, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94d3ea77-5e, col_values=(('external_ids', {'iface-id': '94d3ea77-5eb2-4eaf-b0e8-150394cce1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:1e:65', 'vm-uuid': '4fe9c190-01f0-4d1c-af66-cd61aa8334ee'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:56 user nova-compute[73158]: INFO os_vif [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e')
Aug 17 10:23:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-d4e5a10c-5112-4d38-a061-5a02dfabbe5b req-7b1852a7-39c3-49b0-b1ef-37f9d4213cc3 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d4e5a10c-5112-4d38-a061-5a02dfabbe5b req-7b1852a7-39c3-49b0-b1ef-37f9d4213cc3 service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d4e5a10c-5112-4d38-a061-5a02dfabbe5b req-7b1852a7-39c3-49b0-b1ef-37f9d4213cc3 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d4e5a10c-5112-4d38-a061-5a02dfabbe5b req-7b1852a7-39c3-49b0-b1ef-37f9d4213cc3 service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-d4e5a10c-5112-4d38-a061-5a02dfabbe5b req-7b1852a7-39c3-49b0-b1ef-37f9d4213cc3 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:23:58 user nova-compute[73158]: WARNING nova.compute.manager [req-d4e5a10c-5112-4d38-a061-5a02dfabbe5b req-7b1852a7-39c3-49b0-b1ef-37f9d4213cc3 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state resized and task_state resize_reverting.
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:23:59 user nova-compute[73158]: INFO nova.compute.manager [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Unrescuing
Aug 17 10:23:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:23:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:23:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'flavor' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267840.4697113, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Resumed (Lifecycle Event)
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance running successfully.
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] finish_revert_migration finished successfully. {{(pid=73158) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267840.470927, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Started (Lifecycle Event)
Aug 17 10:24:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.compute.manager [None req-327174a5-90b8-4db0-9365-bebc6831ecb4 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance to original state: 'active'
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:00 user nova-compute[73158]: WARNING nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state active and task_state None.
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:00 user nova-compute[73158]: WARNING nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:00 user nova-compute[73158]: WARNING nova.compute.manager [req-db68683c-2c78-4435-81f6-a301dc010949 req-ee935769-7a80-4819-acd0-c45c5850be0a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:24:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance destroyed successfully.
Aug 17 10:24:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-eccf896d-9211-4029-84a8-3d24dd67e4ac req-2ada74a2-d2e3-4dbb-af2f-5ae10fe284e2 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eccf896d-9211-4029-84a8-3d24dd67e4ac req-2ada74a2-d2e3-4dbb-af2f-5ae10fe284e2 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eccf896d-9211-4029-84a8-3d24dd67e4ac req-2ada74a2-d2e3-4dbb-af2f-5ae10fe284e2 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eccf896d-9211-4029-84a8-3d24dd67e4ac req-2ada74a2-d2e3-4dbb-af2f-5ae10fe284e2 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-eccf896d-9211-4029-84a8-3d24dd67e4ac req-2ada74a2-d2e3-4dbb-af2f-5ae10fe284e2 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:02 user nova-compute[73158]: WARNING nova.compute.manager [req-eccf896d-9211-4029-84a8-3d24dd67e4ac req-2ada74a2-d2e3-4dbb-af2f-5ae10fe284e2 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 447f35f1-f3c6-4f5e-96e7-19399846c8f0 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267844.602641, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Resumed (Lifecycle Event)
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0dba39b5-cc4c-43f3-a552-f93e99925bd3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:24:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267844.6039429, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Started (Lifecycle Event)
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-eb83582b-9c79-4d96-9710-8de21f8edd4a req-9df3f128-2f09-4d17-aa25-9d5ec67e709c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eb83582b-9c79-4d96-9710-8de21f8edd4a req-9df3f128-2f09-4d17-aa25-9d5ec67e709c service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eb83582b-9c79-4d96-9710-8de21f8edd4a req-9df3f128-2f09-4d17-aa25-9d5ec67e709c service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eb83582b-9c79-4d96-9710-8de21f8edd4a req-9df3f128-2f09-4d17-aa25-9d5ec67e709c service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-eb83582b-9c79-4d96-9710-8de21f8edd4a req-9df3f128-2f09-4d17-aa25-9d5ec67e709c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:04 user nova-compute[73158]: WARNING nova.compute.manager [req-eb83582b-9c79-4d96-9710-8de21f8edd4a req-9df3f128-2f09-4d17-aa25-9d5ec67e709c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state active and task_state None.
Aug 17 10:24:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:08 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267833.77597, ad8969a2-c443-4bba-b7d2-2b85a77e7bbc => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:08 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] VM Stopped (Lifecycle Event)
Aug 17 10:24:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-36c6f10d-4763-444c-aca6-1ec7fbac2fee None None] [instance: ad8969a2-c443-4bba-b7d2-2b85a77e7bbc] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-changed-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Refreshing instance network info cache due to event network-changed-c4a37a83-ea29-42a9-8f6c-37fec489ba6c. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:24:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] Acquiring lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:24:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] Acquired lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:24:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Refreshing network info cache for port c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updated VIF entry in instance network info cache for port c4a37a83-ea29-42a9-8f6c-37fec489ba6c. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updating instance_info_cache with network_info: [{"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b4a5dc79-1947-49bd-8e6c-694b7f6e8109 req-81428fe0-98b8-4f85-9968-70a1b5c6654e service nova] Releasing lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'flavor' on Instance uuid 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:14 user nova-compute[73158]: INFO nova.compute.manager [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Attaching volume 9639ddbb-6121-4d07-a78a-a038ea10257d to /dev/vdb
Aug 17 10:24:14 user nova-compute[73158]: DEBUG os_brick.utils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b82f6f6-ccbc-4972-a68d-7779edc29d08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbe08f3-6a99-43e9-a0fd-b728ac14012b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b8834-f14d-4436-992e-b651fea71af7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86931fc-b25c-4c96-b8e5-ec53a6c7543a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:24:14 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:24:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2577d0-2027-48dd-b85a-9ae2ce760fa4]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG os_brick.utils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:24:14 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updating existing volume attachment record: 5cb40308-dded-4837-83bc-eb1d5356edae {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:24:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vylWmjXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:24:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:24:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:24:25 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[99049a60-0141-476d-9b0b-ebc04412ecd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:24:25 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b77c03-d706-4f34-b4b6-abccb42d104f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d] added
Aug 17 10:24:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[09752690-6bac-4428-adf5-fea67660f454]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d38413-1ee2-4a72-9a95-1561e5145e7f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vylWmjXH {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vylWmjXH" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8a6910-6b87-4ab7-8617-f14bc05f10bf]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vylWmjXH'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a6730-e367-4563-aea3-51d989f75e7f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3f126-a9e1-4d9f-bdfd-38769494f045]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:24:25 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:24:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc9236-cae0-42f0-a930-b37e8e74dd5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260]
Aug 17 10:24:25 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260] successful.
Aug 17 10:24:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df1bfe0-be12-4a6b-81e6-b2111af2866e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2531c7-5ce6-43a4-a793-7eb5543c7e07]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d (non-flash)
Aug 17 10:24:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:24:26 user nova-compute[73158]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d (non-flash)
Aug 17 10:24:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f15b2-0d91-418d-9054-5c34057a0334]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vylWmjXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26330323064386532', 'path': '/dev/sdg'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330323064386532', 'path': '/dev/sdg'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'flavor' on Instance uuid 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:24:27 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:24:27 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:24:27 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:24:27 user nova-compute[73158]:   <serial>9639ddbb-6121-4d07-a78a-a038ea10257d</serial>
Aug 17 10:24:27 user nova-compute[73158]: </disk>
Aug 17 10:24:27 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] No VIF found with MAC fa:16:3e:37:40:57, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:24:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5433d9fa-34a7-403d-83ea-ff5286665774 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.972s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:29 user nova-compute[73158]: INFO nova.compute.manager [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Detaching volume 9639ddbb-6121-4d07-a78a-a038ea10257d
Aug 17 10:24:30 user nova-compute[73158]: INFO nova.virt.block_device [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Attempting to driver detach volume 9639ddbb-6121-4d07-a78a-a038ea10257d from mountpoint /dev/vdb
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Attempting to detach device vdb from instance 19672aa4-812e-4a2f-8d96-002fa79b708f from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:24:30 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:24:30 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:24:30 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:24:30 user nova-compute[73158]:   <serial>9639ddbb-6121-4d07-a78a-a038ea10257d</serial>
Aug 17 10:24:30 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:24:30 user nova-compute[73158]: </disk>
Aug 17 10:24:30 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:24:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully detached device vdb from instance 19672aa4-812e-4a2f-8d96-002fa79b708f from the persistent domain config.
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 19672aa4-812e-4a2f-8d96-002fa79b708f from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:24:30 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:24:30 user nova-compute[73158]:   <source dev="/dev/sdg"/>
Aug 17 10:24:30 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:24:30 user nova-compute[73158]:   <serial>9639ddbb-6121-4d07-a78a-a038ea10257d</serial>
Aug 17 10:24:30 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:24:30 user nova-compute[73158]: </disk>
Aug 17 10:24:30 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [{"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-6450f74c-709c-47b9-9d6a-74aa81de118f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267870.5293567, 19672aa4-812e-4a2f-8d96-002fa79b708f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:24:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully detached device vdb from instance 19672aa4-812e-4a2f-8d96-002fa79b708f from the live domain config.
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vylWmjXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:24:30 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[13251547-4d49-417e-a303-43b97bbe2db9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f257136-dcfc-49de-9409-758cd4dbe2ca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d (non-flash)
Aug 17 10:24:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:24:30 user nova-compute[73158]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d (non-flash)
Aug 17 10:24:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc427495a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d'): ({'sdg'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Removing single pathed devices sdg {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46ddcf4-242a-42ee-bedf-1571e771d62b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[462129a4-5bb2-4687-90c9-966815b02803]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Flushing IO for device /dev/sdg {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5c5da4-a9ed-4a88-b58a-f84433279e73]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[177aa73d-89ed-4337-a33b-2bc4d9d081c9]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] SCSI volumes sdg have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eeedad-bd79-413c-9116-8e5d6901fa39]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a8760c-be66-4dd4-95f6-e70bfd77e171]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260]
Aug 17 10:24:30 user nova-compute[73158]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d, portal: 172.16.0.220,3260] successful.
Aug 17 10:24:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639ddbb-6121-4d07-a78a-a038ea10257d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[be151feb-916a-483c-8299-eb47ad4e0f4b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] <== disconnect_volume: return (386ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:24:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'flavor' on Instance uuid 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9611659f-c88e-4760-8a13-bffff4e4dabe tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.084s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:24:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:24:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:24:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=6809MB free_disk=23.934127807617188GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3e106ed-a561-4519-bff8-a911f5e46d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 19672aa4-812e-4a2f-8d96-002fa79b708f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:24:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:36 user nova-compute[73158]: INFO nova.compute.manager [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Terminating instance
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-7c1adbf2-3040-4097-991d-d27d91d1ff9b req-a380853d-31a7-4d75-8404-857c13c279ea service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7c1adbf2-3040-4097-991d-d27d91d1ff9b req-a380853d-31a7-4d75-8404-857c13c279ea service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7c1adbf2-3040-4097-991d-d27d91d1ff9b req-a380853d-31a7-4d75-8404-857c13c279ea service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7c1adbf2-3040-4097-991d-d27d91d1ff9b req-a380853d-31a7-4d75-8404-857c13c279ea service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-7c1adbf2-3040-4097-991d-d27d91d1ff9b req-a380853d-31a7-4d75-8404-857c13c279ea service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-7c1adbf2-3040-4097-991d-d27d91d1ff9b req-a380853d-31a7-4d75-8404-857c13c279ea service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-unplugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Instance destroyed successfully.
Aug 17 10:24:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lazy-loading 'resources' on Instance uuid a3e106ed-a561-4519-bff8-a911f5e46d4b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2006961583',display_name='tempest-ServerStableDeviceRescueTest-server-2006961583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2006961583',id=18,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYx+MQ9jBtSnlZpT+DBE6krXkBjkA+0nJFJbt+ICPaMhJLEuSMyfCwWGQShRsF1DLX9iM1onVAoHR1ebCKPgvBE/VMphZRpVv9fAB3AR1M1oLqMkZdCqH/nIVrz298Fw==',key_name='tempest-keypair-1238312178',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26a300e5d1364d659313c9188a1edcf9',ramdisk_id='',reservation_id='r-b56pkd56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2030255454',owner_user_name='tempest-ServerStableDeviceRescueTest-2030255454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b067ceed67741b8acb93ab97ba02b66',uuid=a3e106ed-a561-4519-bff8-a911f5e46d4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converting VIF {"id": "ac4b8c1e-6806-40ab-990f-4686051d1286", "address": "fa:16:3e:2c:e2:f5", "network": {"id": "47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646558813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26a300e5d1364d659313c9188a1edcf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4b8c1e-68", "ovs_interfaceid": "ac4b8c1e-6806-40ab-990f-4686051d1286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG os_vif [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac4b8c1e-68, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:37 user nova-compute[73158]: INFO os_vif [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:e2:f5,bridge_name='br-int',has_traffic_filtering=True,id=ac4b8c1e-6806-40ab-990f-4686051d1286,network=Network(47620cab-ed8c-4f0e-aac3-7e6ee2ab0f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4b8c1e-68')
Aug 17 10:24:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Deleting instance files /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b_del
Aug 17 10:24:37 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Deletion of /opt/stack/data/nova/instances/a3e106ed-a561-4519-bff8-a911f5e46d4b_del complete
Aug 17 10:24:37 user nova-compute[73158]: INFO nova.compute.manager [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 10:24:37 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:24:37 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:38 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Took 0.85 seconds to deallocate network for instance.
Aug 17 10:24:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-ea991b1d-41a9-4fe6-8ac7-e1448521cfcf req-b49fba8a-c9d7-4c97-ad2d-68f60ae38dbf service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-deleted-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:38 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Deleted allocations for instance a3e106ed-a561-4519-bff8-a911f5e46d4b
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7f9e8796-3168-4dd2-99d0-d4abc2e644d2 tempest-ServerStableDeviceRescueTest-2030255454 tempest-ServerStableDeviceRescueTest-2030255454-project-member] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-b6fbbcaa-c50e-456d-8e0d-2e9021a15be1 req-39dbdfd8-dd8f-4e90-b941-373b30a08a9a service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b6fbbcaa-c50e-456d-8e0d-2e9021a15be1 req-39dbdfd8-dd8f-4e90-b941-373b30a08a9a service nova] Acquiring lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b6fbbcaa-c50e-456d-8e0d-2e9021a15be1 req-39dbdfd8-dd8f-4e90-b941-373b30a08a9a service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b6fbbcaa-c50e-456d-8e0d-2e9021a15be1 req-39dbdfd8-dd8f-4e90-b941-373b30a08a9a service nova] Lock "a3e106ed-a561-4519-bff8-a911f5e46d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-b6fbbcaa-c50e-456d-8e0d-2e9021a15be1 req-39dbdfd8-dd8f-4e90-b941-373b30a08a9a service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] No waiting events found dispatching network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:38 user nova-compute[73158]: WARNING nova.compute.manager [req-b6fbbcaa-c50e-456d-8e0d-2e9021a15be1 req-39dbdfd8-dd8f-4e90-b941-373b30a08a9a service nova] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Received unexpected event network-vif-plugged-ac4b8c1e-6806-40ab-990f-4686051d1286 for instance with vm_state deleted and task_state None.
Aug 17 10:24:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:46 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:24:46 user nova-compute[73158]: INFO nova.compute.claims [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Claim successful on node user
Aug 17 10:24:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:24:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:24:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Creating image(s)
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "/opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG nova.policy [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1978c81194804f6cbd5e98332c36d19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14552145aeb14d838370c33104ae8374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk 1073741824" returned: 0 in 0.051s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Successfully created port: 6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Cannot resize image /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'migration_context' on Instance uuid 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Ensure instance console log exists: /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Successfully updated port: 6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquired lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-changed-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Refreshing instance network info cache due to event network-changed-6ee15fce-fad3-4b26-8da7-a496a7da96c2. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] Acquiring lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updating instance_info_cache with network_info: [{"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Releasing lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Instance network_info: |[{"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] Acquired lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Refreshing network info cache for port 6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Start _get_guest_xml network_info=[{"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:24:49 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:24:49 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:24:49 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1100366227',display_name='tempest-AttachVolumeNegativeTest-server-1100366227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1100366227',id=30,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfwdcNskz4pSWWPRPMgO+3nxRElfJqV2t8+gAbpjPY719bazjoCxjBmKr0irOpB6SniSZ4jxg5fEczN7GmUBLstXiuB+YmHQRnRa3xvnpOUFsyC6d9ZXep/i0++35vFgg==',key_name='tempest-keypair-1761684782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-3lqd5ur7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=65ca631c-9503-43e3-8b01-c350d9c1eb3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'pci_devices' on Instance uuid 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:24:50 user nova-compute[73158]:   <uuid>65ca631c-9503-43e3-8b01-c350d9c1eb3e</uuid>
Aug 17 10:24:50 user nova-compute[73158]:   <name>instance-0000001e</name>
Aug 17 10:24:50 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:24:50 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:24:50 user nova-compute[73158]:   <metadata>
Aug 17 10:24:50 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:24:50 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:24:50 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1100366227</nova:name>
Aug 17 10:24:50 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:24:49</nova:creationTime>
Aug 17 10:24:50 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:24:50 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:24:50 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:24:50 user nova-compute[73158]:       <nova:owner>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:user uuid="1978c81194804f6cbd5e98332c36d19d">tempest-AttachVolumeNegativeTest-1781394635-project-member</nova:user>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:project uuid="14552145aeb14d838370c33104ae8374">tempest-AttachVolumeNegativeTest-1781394635</nova:project>
Aug 17 10:24:50 user nova-compute[73158]:       </nova:owner>
Aug 17 10:24:50 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:24:50 user nova-compute[73158]:       <nova:ports>
Aug 17 10:24:50 user nova-compute[73158]:         <nova:port uuid="6ee15fce-fad3-4b26-8da7-a496a7da96c2">
Aug 17 10:24:50 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 10:24:50 user nova-compute[73158]:         </nova:port>
Aug 17 10:24:50 user nova-compute[73158]:       </nova:ports>
Aug 17 10:24:50 user nova-compute[73158]:     </nova:instance>
Aug 17 10:24:50 user nova-compute[73158]:   </metadata>
Aug 17 10:24:50 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:24:50 user nova-compute[73158]:     <system>
Aug 17 10:24:50 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:24:50 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:24:50 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:24:50 user nova-compute[73158]:       <entry name="serial">65ca631c-9503-43e3-8b01-c350d9c1eb3e</entry>
Aug 17 10:24:50 user nova-compute[73158]:       <entry name="uuid">65ca631c-9503-43e3-8b01-c350d9c1eb3e</entry>
Aug 17 10:24:50 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:24:50 user nova-compute[73158]:     </system>
Aug 17 10:24:50 user nova-compute[73158]:   </sysinfo>
Aug 17 10:24:50 user nova-compute[73158]:   <os>
Aug 17 10:24:50 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:24:50 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:24:50 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:24:50 user nova-compute[73158]:   </os>
Aug 17 10:24:50 user nova-compute[73158]:   <features>
Aug 17 10:24:50 user nova-compute[73158]:     <acpi/>
Aug 17 10:24:50 user nova-compute[73158]:     <apic/>
Aug 17 10:24:50 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:24:50 user nova-compute[73158]:   </features>
Aug 17 10:24:50 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:24:50 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:24:50 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:24:50 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:24:50 user nova-compute[73158]:   </clock>
Aug 17 10:24:50 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:24:50 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:24:50 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:24:50 user nova-compute[73158]:   </cpu>
Aug 17 10:24:50 user nova-compute[73158]:   <devices>
Aug 17 10:24:50 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:24:50 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:24:50 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk"/>
Aug 17 10:24:50 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:24:50 user nova-compute[73158]:     </disk>
Aug 17 10:24:50 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:24:50 user nova-compute[73158]:       <mac address="fa:16:3e:20:f6:7b"/>
Aug 17 10:24:50 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:24:50 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:24:50 user nova-compute[73158]:       <target dev="tap6ee15fce-fa"/>
Aug 17 10:24:50 user nova-compute[73158]:     </interface>
Aug 17 10:24:50 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:24:50 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/console.log" append="off"/>
Aug 17 10:24:50 user nova-compute[73158]:     </serial>
Aug 17 10:24:50 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:24:50 user nova-compute[73158]:     <video>
Aug 17 10:24:50 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:24:50 user nova-compute[73158]:     </video>
Aug 17 10:24:50 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:24:50 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:24:50 user nova-compute[73158]:     </rng>
Aug 17 10:24:50 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:24:50 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:24:50 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:24:50 user nova-compute[73158]:     </memballoon>
Aug 17 10:24:50 user nova-compute[73158]:   </devices>
Aug 17 10:24:50 user nova-compute[73158]: </domain>
Aug 17 10:24:50 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1100366227',display_name='tempest-AttachVolumeNegativeTest-server-1100366227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1100366227',id=30,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfwdcNskz4pSWWPRPMgO+3nxRElfJqV2t8+gAbpjPY719bazjoCxjBmKr0irOpB6SniSZ4jxg5fEczN7GmUBLstXiuB+YmHQRnRa3xvnpOUFsyC6d9ZXep/i0++35vFgg==',key_name='tempest-keypair-1761684782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-3lqd5ur7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=65ca631c-9503-43e3-8b01-c350d9c1eb3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG os_vif [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ee15fce-fa, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ee15fce-fa, col_values=(('external_ids', {'iface-id': '6ee15fce-fad3-4b26-8da7-a496a7da96c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:f6:7b', 'vm-uuid': '65ca631c-9503-43e3-8b01-c350d9c1eb3e'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:50 user nova-compute[73158]: INFO os_vif [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa')
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:20:f6:7b, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updated VIF entry in instance network info cache for port 6ee15fce-fad3-4b26-8da7-a496a7da96c2. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updating instance_info_cache with network_info: [{"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f07c9f35-22fe-44e0-b68a-736c6349e4d4 req-42811efa-eb7f-40c1-ac26-bb79cb37e998 service nova] Releasing lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-81500ff4-19c5-4fcf-a2e6-a003ad6a2c3d req-6e7eb711-298e-44db-9ca4-c24094df1c7c service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-81500ff4-19c5-4fcf-a2e6-a003ad6a2c3d req-6e7eb711-298e-44db-9ca4-c24094df1c7c service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-81500ff4-19c5-4fcf-a2e6-a003ad6a2c3d req-6e7eb711-298e-44db-9ca4-c24094df1c7c service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-81500ff4-19c5-4fcf-a2e6-a003ad6a2c3d req-6e7eb711-298e-44db-9ca4-c24094df1c7c service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-81500ff4-19c5-4fcf-a2e6-a003ad6a2c3d req-6e7eb711-298e-44db-9ca4-c24094df1c7c service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:51 user nova-compute[73158]: WARNING nova.compute.manager [req-81500ff4-19c5-4fcf-a2e6-a003ad6a2c3d req-6e7eb711-298e-44db-9ca4-c24094df1c7c service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received unexpected event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with vm_state building and task_state spawning.
Aug 17 10:24:52 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267877.317256, a3e106ed-a561-4519-bff8-a911f5e46d4b => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:52 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] VM Stopped (Lifecycle Event)
Aug 17 10:24:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-dd887170-f343-4906-9dcd-b948fbb5d7d1 None None] [instance: a3e106ed-a561-4519-bff8-a911f5e46d4b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267893.5700214, 65ca631c-9503-43e3-8b01-c350d9c1eb3e => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] VM Resumed (Lifecycle Event)
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Instance spawned successfully.
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267893.5715606, 65ca631c-9503-43e3-8b01-c350d9c1eb3e => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] VM Started (Lifecycle Event)
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-239f775c-8ab4-448a-bffb-ca85dd27f1e2 req-1f50f65f-155e-46f7-8ecc-0a9bc2292936 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-239f775c-8ab4-448a-bffb-ca85dd27f1e2 req-1f50f65f-155e-46f7-8ecc-0a9bc2292936 service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-239f775c-8ab4-448a-bffb-ca85dd27f1e2 req-1f50f65f-155e-46f7-8ecc-0a9bc2292936 service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-239f775c-8ab4-448a-bffb-ca85dd27f1e2 req-1f50f65f-155e-46f7-8ecc-0a9bc2292936 service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-239f775c-8ab4-448a-bffb-ca85dd27f1e2 req-1f50f65f-155e-46f7-8ecc-0a9bc2292936 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:24:53 user nova-compute[73158]: WARNING nova.compute.manager [req-239f775c-8ab4-448a-bffb-ca85dd27f1e2 req-1f50f65f-155e-46f7-8ecc-0a9bc2292936 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received unexpected event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with vm_state building and task_state spawning.
Aug 17 10:24:53 user nova-compute[73158]: INFO nova.compute.manager [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Took 6.80 seconds to build instance.
Aug 17 10:24:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e43b47d-da2a-4763-868c-85e7de373ecb tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.909s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:24:55 user nova-compute[73158]: INFO nova.compute.claims [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Claim successful on node user
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:24:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.policy [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bfd8d8513d24d0d893689d5db089546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbba4c18d534970a667590744f891a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:24:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Creating image(s)
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk 1073741824" returned: 0 in 0.053s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Successfully created port: 52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Cannot resize image /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'migration_context' on Instance uuid f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Ensure instance console log exists: /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:24:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Successfully updated port: 52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-changed-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Refreshing instance network info cache due to event network-changed-52793cae-8d75-47b1-9299-e04e50c58905. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] Acquiring lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Updating instance_info_cache with network_info: [{"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Instance network_info: |[{"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] Acquired lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Refreshing network info cache for port 52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Start _get_guest_xml network_info=[{"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:24:58 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:24:58 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-202081318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-202081318',id=31,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-017d2ftj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:24:56Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'pci_devices' on Instance uuid f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:24:58 user nova-compute[73158]:   <uuid>f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b</uuid>
Aug 17 10:24:58 user nova-compute[73158]:   <name>instance-0000001f</name>
Aug 17 10:24:58 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:24:58 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:24:58 user nova-compute[73158]:   <metadata>
Aug 17 10:24:58 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:24:58 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:24:58 user nova-compute[73158]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-202081318</nova:name>
Aug 17 10:24:58 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:24:58</nova:creationTime>
Aug 17 10:24:58 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:24:58 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:24:58 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:24:58 user nova-compute[73158]:       <nova:owner>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:user uuid="9bfd8d8513d24d0d893689d5db089546">tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member</nova:user>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:project uuid="9bbba4c18d534970a667590744f891a2">tempest-ServerBootFromVolumeStableRescueTest-184800752</nova:project>
Aug 17 10:24:58 user nova-compute[73158]:       </nova:owner>
Aug 17 10:24:58 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:24:58 user nova-compute[73158]:       <nova:ports>
Aug 17 10:24:58 user nova-compute[73158]:         <nova:port uuid="52793cae-8d75-47b1-9299-e04e50c58905">
Aug 17 10:24:58 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 10:24:58 user nova-compute[73158]:         </nova:port>
Aug 17 10:24:58 user nova-compute[73158]:       </nova:ports>
Aug 17 10:24:58 user nova-compute[73158]:     </nova:instance>
Aug 17 10:24:58 user nova-compute[73158]:   </metadata>
Aug 17 10:24:58 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:24:58 user nova-compute[73158]:     <system>
Aug 17 10:24:58 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:24:58 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:24:58 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:24:58 user nova-compute[73158]:       <entry name="serial">f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b</entry>
Aug 17 10:24:58 user nova-compute[73158]:       <entry name="uuid">f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b</entry>
Aug 17 10:24:58 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:24:58 user nova-compute[73158]:     </system>
Aug 17 10:24:58 user nova-compute[73158]:   </sysinfo>
Aug 17 10:24:58 user nova-compute[73158]:   <os>
Aug 17 10:24:58 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:24:58 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:24:58 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:24:58 user nova-compute[73158]:   </os>
Aug 17 10:24:58 user nova-compute[73158]:   <features>
Aug 17 10:24:58 user nova-compute[73158]:     <acpi/>
Aug 17 10:24:58 user nova-compute[73158]:     <apic/>
Aug 17 10:24:58 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:24:58 user nova-compute[73158]:   </features>
Aug 17 10:24:58 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:24:58 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:24:58 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:24:58 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:24:58 user nova-compute[73158]:   </clock>
Aug 17 10:24:58 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:24:58 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:24:58 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:24:58 user nova-compute[73158]:   </cpu>
Aug 17 10:24:58 user nova-compute[73158]:   <devices>
Aug 17 10:24:58 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:24:58 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:24:58 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk"/>
Aug 17 10:24:58 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:24:58 user nova-compute[73158]:     </disk>
Aug 17 10:24:58 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:24:58 user nova-compute[73158]:       <mac address="fa:16:3e:32:14:e2"/>
Aug 17 10:24:58 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:24:58 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:24:58 user nova-compute[73158]:       <target dev="tap52793cae-8d"/>
Aug 17 10:24:58 user nova-compute[73158]:     </interface>
Aug 17 10:24:58 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:24:58 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/console.log" append="off"/>
Aug 17 10:24:58 user nova-compute[73158]:     </serial>
Aug 17 10:24:58 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:24:58 user nova-compute[73158]:     <video>
Aug 17 10:24:58 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:24:58 user nova-compute[73158]:     </video>
Aug 17 10:24:58 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:24:58 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:24:58 user nova-compute[73158]:     </rng>
Aug 17 10:24:58 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:24:58 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:24:58 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:24:58 user nova-compute[73158]:     </memballoon>
Aug 17 10:24:58 user nova-compute[73158]:   </devices>
Aug 17 10:24:58 user nova-compute[73158]: </domain>
Aug 17 10:24:58 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-202081318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-202081318',id=31,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-017d2ftj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:24:56Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG os_vif [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52793cae-8d, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52793cae-8d, col_values=(('external_ids', {'iface-id': '52793cae-8d75-47b1-9299-e04e50c58905', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:14:e2', 'vm-uuid': 'f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:58 user nova-compute[73158]: INFO os_vif [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d')
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No VIF found with MAC fa:16:3e:32:14:e2, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Updated VIF entry in instance network info cache for port 52793cae-8d75-47b1-9299-e04e50c58905. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:24:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Updating instance_info_cache with network_info: [{"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:24:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ca2a331e-cd17-463b-913d-95e08430a4d6 req-dc79e8cf-f2cf-487e-894c-b0b8c0fdfb59 service nova] Releasing lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:24:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:24:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-52fc7022-74bf-4c65-b1ba-953bfc840be5 req-c947d64b-0987-415b-bd20-7eee011a7ddb service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-52fc7022-74bf-4c65-b1ba-953bfc840be5 req-c947d64b-0987-415b-bd20-7eee011a7ddb service nova] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-52fc7022-74bf-4c65-b1ba-953bfc840be5 req-c947d64b-0987-415b-bd20-7eee011a7ddb service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-52fc7022-74bf-4c65-b1ba-953bfc840be5 req-c947d64b-0987-415b-bd20-7eee011a7ddb service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-52fc7022-74bf-4c65-b1ba-953bfc840be5 req-c947d64b-0987-415b-bd20-7eee011a7ddb service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] No waiting events found dispatching network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:00 user nova-compute[73158]: WARNING nova.compute.manager [req-52fc7022-74bf-4c65-b1ba-953bfc840be5 req-c947d64b-0987-415b-bd20-7eee011a7ddb service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received unexpected event network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 for instance with vm_state building and task_state spawning.
Aug 17 10:25:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267902.0285664, f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] VM Resumed (Lifecycle Event)
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Instance spawned successfully.
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267902.0306942, f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] VM Started (Lifecycle Event)
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:02 user nova-compute[73158]: INFO nova.compute.manager [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Took 6.50 seconds to build instance.
Aug 17 10:25:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ce3c478-7566-43a9-9060-6d7f8d84dd34 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.585s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-2d94fefd-f305-43a8-9661-58e041516f01 req-0166451c-cf61-41d1-a285-341fd0ba132e service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d94fefd-f305-43a8-9661-58e041516f01 req-0166451c-cf61-41d1-a285-341fd0ba132e service nova] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d94fefd-f305-43a8-9661-58e041516f01 req-0166451c-cf61-41d1-a285-341fd0ba132e service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d94fefd-f305-43a8-9661-58e041516f01 req-0166451c-cf61-41d1-a285-341fd0ba132e service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-2d94fefd-f305-43a8-9661-58e041516f01 req-0166451c-cf61-41d1-a285-341fd0ba132e service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] No waiting events found dispatching network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:02 user nova-compute[73158]: WARNING nova.compute.manager [req-2d94fefd-f305-43a8-9661-58e041516f01 req-0166451c-cf61-41d1-a285-341fd0ba132e service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received unexpected event network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 for instance with vm_state active and task_state None.
Aug 17 10:25:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-changed-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Refreshing instance network info cache due to event network-changed-109973c2-4d29-48ed-8141-e45dc9ec66f7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Refreshing network info cache for port 109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated VIF entry in instance network info cache for port 109973c2-4d29-48ed-8141-e45dc9ec66f7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-258134b6-9594-4155-9c6e-468033087592 req-0a806255-0d93-4d09-ae76-b9430332dc9f service nova] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Stashing vm_state: active {{(pid=73158) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 10:25:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_requests' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:25:14 user nova-compute[73158]: INFO nova.compute.claims [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Claim successful on node user
Aug 17 10:25:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'resources' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'pci_devices' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:14 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating resource usage from migration e9085077-8046-4c75-a716-5ce982c8e3c6
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-changed-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Refreshing instance network info cache due to event network-changed-575c37dd-5734-46db-9e11-58ff9dd0b1e0. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] Acquiring lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] Acquired lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Refreshing network info cache for port 575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.622s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:15 user nova-compute[73158]: INFO nova.compute.manager [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Migrating
Aug 17 10:25:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updated VIF entry in instance network info cache for port 575c37dd-5734-46db-9e11-58ff9dd0b1e0. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8a0de136-8c3b-4159-99ef-a8d4047533e7 req-a3cce29a-8f1d-4704-8058-d3c8687f5799 service nova] Releasing lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquired lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:15 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Releasing lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Starting migrate_disk_and_power_off {{(pid=73158) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-2dba4794-0d6b-482c-a331-348948f64555 req-099ee6f2-944e-4798-b915-baf1d52559e0 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-unplugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2dba4794-0d6b-482c-a331-348948f64555 req-099ee6f2-944e-4798-b915-baf1d52559e0 service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2dba4794-0d6b-482c-a331-348948f64555 req-099ee6f2-944e-4798-b915-baf1d52559e0 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2dba4794-0d6b-482c-a331-348948f64555 req-099ee6f2-944e-4798-b915-baf1d52559e0 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-2dba4794-0d6b-482c-a331-348948f64555 req-099ee6f2-944e-4798-b915-baf1d52559e0 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-unplugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:16 user nova-compute[73158]: WARNING nova.compute.manager [req-2dba4794-0d6b-482c-a331-348948f64555 req-099ee6f2-944e-4798-b915-baf1d52559e0 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-unplugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state active and task_state resize_migrating.
Aug 17 10:25:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance destroyed successfully.
Aug 17 10:25:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-796905679',display_name='tempest-ServerActionsTestOtherA-server-796905679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-796905679',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-5t2q7aa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=008cc48e-5db1-4f5d-b133-e9577cabe4f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap575c37dd-57, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:25:17 user nova-compute[73158]: INFO os_vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57')
Aug 17 10:25:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:17 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c8baf-5b51-4377-8fb3-4c4052ae7048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220a9ff-3b5f-48e7-befa-284ca263a70b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:17 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c1620e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfe662a-f06e-4ea0-877c-cc14ff62ba5c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e435c43-c25a-4cc6-99a4-7448406a8f53]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ffd62-d9e2-4627-9bda-b0812899ff5c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a1287-0623-496a-a76f-01aa9d1dcdda]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_144ac29a', '/dev/disk/by-id/scsi-23231656635363231', '/dev/disk/by-id/scsi-1SCST_BIO144ac29a-21ef562179c22eea') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0b0062-3c80-4bb5-bb9e-9c1daa19f487]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[32015b9d-447b-4135-be85-c96f4fcde82d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5655e7-e7f9-4dae-9815-c22ea480e0db]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]
Aug 17 10:25:17 user nova-compute[73158]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.
Aug 17 10:25:17 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a980b3-03af-48bd-9fea-1e0f72bff0d4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== disconnect_volume: return (397ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:25:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Port 575c37dd-5734-46db-9e11-58ff9dd0b1e0 binding to destination host user is already ACTIVE {{(pid=73158) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7668c98-7829-4b9f-be0e-c9c4b0a33f8e req-e755cf9e-6dc0-49fe-ad10-fc50a441d948 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7668c98-7829-4b9f-be0e-c9c4b0a33f8e req-e755cf9e-6dc0-49fe-ad10-fc50a441d948 service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7668c98-7829-4b9f-be0e-c9c4b0a33f8e req-e755cf9e-6dc0-49fe-ad10-fc50a441d948 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7668c98-7829-4b9f-be0e-c9c4b0a33f8e req-e755cf9e-6dc0-49fe-ad10-fc50a441d948 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7668c98-7829-4b9f-be0e-c9c4b0a33f8e req-e755cf9e-6dc0-49fe-ad10-fc50a441d948 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:18 user nova-compute[73158]: WARNING nova.compute.manager [req-f7668c98-7829-4b9f-be0e-c9c4b0a33f8e req-e755cf9e-6dc0-49fe-ad10-fc50a441d948 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state active and task_state resize_migrating.
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquired lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Detaching volume 81bda531-49e8-45de-8ef6-a343c1e54216
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Releasing lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:19 user nova-compute[73158]: INFO nova.virt.block_device [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Attempting to driver detach volume 81bda531-49e8-45de-8ef6-a343c1e54216 from mountpoint /dev/vdb
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Attempting to detach device vdb from instance a6744f73-a7ec-4388-8e15-c05068041a09 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:25:19 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:25:19 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:25:19 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:25:19 user nova-compute[73158]:   <serial>81bda531-49e8-45de-8ef6-a343c1e54216</serial>
Aug 17 10:25:19 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:25:19 user nova-compute[73158]: </disk>
Aug 17 10:25:19 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:25:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully detached device vdb from instance a6744f73-a7ec-4388-8e15-c05068041a09 from the persistent domain config.
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6744f73-a7ec-4388-8e15-c05068041a09 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:25:19 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:25:19 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:25:19 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:25:19 user nova-compute[73158]:   <serial>81bda531-49e8-45de-8ef6-a343c1e54216</serial>
Aug 17 10:25:19 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:25:19 user nova-compute[73158]: </disk>
Aug 17 10:25:19 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.utils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238cf7f-2a68-4cb8-97a1-37f33878c3f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef44b93-048c-4a4e-8fce-dae919781f2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[87974383-685a-49b3-b926-9a5e491d4a25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deb6da0-07e0-4313-9c73-297d62d05307]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:25:19 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2a42c6-632f-4d20-a0f9-3964dde7be19]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.utils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267919.9216912, a6744f73-a7ec-4388-8e15-c05068041a09 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:25:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully detached device vdb from instance a6744f73-a7ec-4388-8e15-c05068041a09 from the live domain config.
Aug 17 10:25:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWQAOaoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:19 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc46d48-6f90-44d3-bbd8-d4322dfae3c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[464631af-40e5-4184-bc7e-28c1ed9727fb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3f3d3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216'): ({'sdd'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Removing single pathed devices sdd {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:25:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f4dde-671a-4b54-b090-2e1d3f7f0884]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f6473-73ea-4e91-9b2d-bf373ee153d6]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flushing IO for device /dev/sdd {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9bcd12-a251-4aa2-b19d-2a618f54d4a7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec9c4a-3cd8-4490-808e-47219f170c24]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0f4ef-3848-4b61-ba09-3b2350c02aec]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98ac9e1-9fb2-4f32-8fb6-919d4d9dbdbc]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260]
Aug 17 10:25:20 user nova-compute[73158]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216, portal: 172.16.0.220,3260] successful.
Aug 17 10:25:20 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bda531-49e8-45de-8ef6-a343c1e54216 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f59251-9256-4f0b-a152-979d0d03212c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== disconnect_volume: return (294ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-changed-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG nova.compute.manager [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Refreshing instance network info cache due to event network-changed-c4a37a83-ea29-42a9-8f6c-37fec489ba6c. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] Acquiring lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] Acquired lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG nova.network.neutron [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Refreshing network info cache for port c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:20 user nova-compute[73158]: INFO nova.compute.manager [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Terminating instance
Aug 17 10:25:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-77f3f088-45cc-4207-88ff-90c07944ba5e req-d6142f4c-3349-46d4-8701-ad4171de2c92 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-vif-unplugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-77f3f088-45cc-4207-88ff-90c07944ba5e req-d6142f4c-3349-46d4-8701-ad4171de2c92 service nova] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-77f3f088-45cc-4207-88ff-90c07944ba5e req-d6142f4c-3349-46d4-8701-ad4171de2c92 service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-77f3f088-45cc-4207-88ff-90c07944ba5e req-d6142f4c-3349-46d4-8701-ad4171de2c92 service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-77f3f088-45cc-4207-88ff-90c07944ba5e req-d6142f4c-3349-46d4-8701-ad4171de2c92 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] No waiting events found dispatching network-vif-unplugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-77f3f088-45cc-4207-88ff-90c07944ba5e req-d6142f4c-3349-46d4-8701-ad4171de2c92 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-vif-unplugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.network.neutron [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updated VIF entry in instance network info cache for port c4a37a83-ea29-42a9-8f6c-37fec489ba6c. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.network.neutron [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updating instance_info_cache with network_info: [{"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ba3c40d6-4975-4209-b14d-71c125606dda req-58b1df82-c39d-4b5b-84dd-ca91cdb33667 service nova] Releasing lock "refresh_cache-19672aa4-812e-4a2f-8d96-002fa79b708f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3144d05f-6be2-4b5c-8f46-46b8b9101b2b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Instance destroyed successfully.
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'resources' on Instance uuid 19672aa4-812e-4a2f-8d96-002fa79b708f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-51631992',display_name='tempest-TestStampPattern-server-51631992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-51631992',id=27,image_ref='570f24c4-0ada-457a-8a43-c2a408864bde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6XIxP0dCINXqjELSrLNjFiRC+1PldH0AChmBMJ5HNVC3DRW7UR8eVYRzITonCUhH/MtY84G5Nh9wiITQ8XKcYuD0UbRRpWG4DHpqdPsono5MbPBjUhIFJKYjWAejQNwg==',key_name='tempest-TestStampPattern-863239552',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf8d6d6113124771be6093c99e106c18',ramdisk_id='',reservation_id='r-vp6jnxzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d2dbefd6-afaf-4446-977f-69c0ead85a01',image_min_disk='1',image_min_ram='0',image_owner_id='cf8d6d6113124771be6093c99e106c18',image_owner_project_name='tempest-TestStampPattern-1495454869',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1495454869-project-member',image_user_id='908f0da6a47c4ba295fee97cf4e88234',owner_project_name='tempest-TestStampPattern-1495454869',owner_user_name='tempest-TestStampPattern-1495454869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:22:30Z,user_data=None,user_id='908f0da6a47c4ba295fee97cf4e88234',uuid=19672aa4-812e-4a2f-8d96-002fa79b708f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converting VIF {"id": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "address": "fa:16:3e:37:40:57", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a37a83-ea", "ovs_interfaceid": "c4a37a83-ea29-42a9-8f6c-37fec489ba6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG os_vif [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a37a83-ea, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:25:21 user nova-compute[73158]: INFO os_vif [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:40:57,bridge_name='br-int',has_traffic_filtering=True,id=c4a37a83-ea29-42a9-8f6c-37fec489ba6c,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a37a83-ea')
Aug 17 10:25:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Deleting instance files /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f_del
Aug 17 10:25:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Deletion of /opt/stack/data/nova/instances/19672aa4-812e-4a2f-8d96-002fa79b708f_del complete
Aug 17 10:25:21 user nova-compute[73158]: INFO nova.compute.manager [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73158) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance destroyed successfully.
Aug 17 10:25:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d6974afe-bef2-4b3c-a3b9-8913e1eb7ca0 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.934s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:22 user nova-compute[73158]: WARNING nova.compute.manager [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state stopped and task_state None.
Aug 17 10:25:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:22 user nova-compute[73158]: WARNING nova.compute.manager [req-75402e94-fad3-4493-808a-44d19c2d6550 req-4a09955e-2933-4dab-b90c-b68ab27310ba service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state stopped and task_state None.
Aug 17 10:25:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:22 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:22 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Took 1.35 seconds to deallocate network for instance.
Aug 17 10:25:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-adf61d1c-94c1-486f-80ae-bb980e265a4f req-57218665-0259-4313-9b69-38d7cd6c7b0f service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-vif-deleted-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-2ac264f6-9b32-4620-b3cd-95c45b02fab0 req-6113e7de-31d7-4933-a791-2fa9023573f8 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received event network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ac264f6-9b32-4620-b3cd-95c45b02fab0 req-6113e7de-31d7-4933-a791-2fa9023573f8 service nova] Acquiring lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ac264f6-9b32-4620-b3cd-95c45b02fab0 req-6113e7de-31d7-4933-a791-2fa9023573f8 service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2ac264f6-9b32-4620-b3cd-95c45b02fab0 req-6113e7de-31d7-4933-a791-2fa9023573f8 service nova] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-2ac264f6-9b32-4620-b3cd-95c45b02fab0 req-6113e7de-31d7-4933-a791-2fa9023573f8 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] No waiting events found dispatching network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:23 user nova-compute[73158]: WARNING nova.compute.manager [req-2ac264f6-9b32-4620-b3cd-95c45b02fab0 req-6113e7de-31d7-4933-a791-2fa9023573f8 service nova] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Received unexpected event network-vif-plugged-c4a37a83-ea29-42a9-8f6c-37fec489ba6c for instance with vm_state deleted and task_state None.
Aug 17 10:25:23 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:23 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Deleted allocations for instance 19672aa4-812e-4a2f-8d96-002fa79b708f
Aug 17 10:25:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-95028e97-15df-4112-b63d-ac4b0e58cf64 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "19672aa4-812e-4a2f-8d96-002fa79b708f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'flavor' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:28 user nova-compute[73158]: INFO nova.compute.manager [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Attaching volume 7e0fd4a4-23c9-481c-8ffc-1717a3940a78 to /dev/vdb
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG os_brick.utils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2d003-54a6-40d7-9de2-cab807d2db69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f5099-c432-4e11-ab17-ea042c94c036]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f1d41-c07a-4107-9940-3052cdd246e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e80276e-4c7c-4f82-b345-617393be8fe5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:25:28 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:25:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db834ad-7d34-4696-9861-7038dea93f0f]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG os_brick.utils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:28 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating existing volume attachment record: dae02c7d-517c-4a99-9f44-33828489860a {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Starting finish_migration {{(pid=73158) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:25:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Creating image(s)
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Ensure instance console log exists: /opt/stack/data/nova/instances/008cc48e-5db1-4f5d-b133-e9577cabe4f8/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Start _get_guest_xml network_info=[{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '9d27ac22-9ec4-4a98-b4a5-be2f6859886a', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '008cc48e-5db1-4f5d-b133-e9577cabe4f8', 'attached_at': '2023-08-17T10:25:31.000000', 'detached_at': '', 'volume_id': 'a2c59f99-32ec-4481-a8d8-85031cc5dfef', 'serial': 'a2c59f99-32ec-4481-a8d8-85031cc5dfef'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:25:31 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.objects.instance [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'vcpu_model' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:31 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:31 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:31 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab83850-14ee-4dcf-ba19-59ef95f1a915]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:25:31 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cd9e2-1639-47a5-891f-e79245fbca28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef] added
Aug 17 10:25:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97b849b-5146-4e8c-99f5-f1ab6274480e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5004b5-c366-4dac-b5aa-695953a0cbb4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFenDGUz {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFenDGUz" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fad94d-0fe6-4ff4-a7a7-f04bbd887673]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFenDGUz'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab12ad8-0681-452f-98d3-1beb0d7515a6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84701ff9-3a35-4b5c-bdb3-8cf18d4f41e9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[98021ec6-cb1f-4f00-a6c0-c07ea3e6e42e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]
Aug 17 10:25:31 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.
Aug 17 10:25:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c38e3-2fe0-41d5-a6cb-58feb57292c3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b140aa1-8a52-4a86-a2e5-c21c4d167d94]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:31 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54c40f-8ca7-4517-81d4-2636268d1fc9]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267917.2630239, 008cc48e-5db1-4f5d-b133-e9577cabe4f8 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:32 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] VM Stopped (Lifecycle Event)
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-aa9d97aa-e6c4-4930-82bc-9e385953f294 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.compute.manager [None req-aa9d97aa-e6c4-4930-82bc-9e385953f294 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:25:32 user nova-compute[73158]: INFO nova.compute.manager [None req-aa9d97aa-e6c4-4930-82bc-9e385953f294 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23231656635363231', 'path': '/dev/sdd'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231656635363231', 'path': '/dev/sdd'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-796905679',display_name='tempest-ServerActionsTestOtherA-server-796905679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-796905679',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-5t2q7aa8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=008cc48e-5db1-4f5d-b133-e9577cabe4f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:25:32 user nova-compute[73158]:   <uuid>008cc48e-5db1-4f5d-b133-e9577cabe4f8</uuid>
Aug 17 10:25:32 user nova-compute[73158]:   <name>instance-0000001c</name>
Aug 17 10:25:32 user nova-compute[73158]:   <memory>2097152</memory>
Aug 17 10:25:32 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:25:32 user nova-compute[73158]:   <metadata>
Aug 17 10:25:32 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:25:32 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:25:32 user nova-compute[73158]:       <nova:name>tempest-ServerActionsTestOtherA-server-796905679</nova:name>
Aug 17 10:25:32 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:25:31</nova:creationTime>
Aug 17 10:25:32 user nova-compute[73158]:       <nova:flavor name="m1.small">
Aug 17 10:25:32 user nova-compute[73158]:         <nova:memory>2048</nova:memory>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:disk>20</nova:disk>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:25:32 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:25:32 user nova-compute[73158]:       <nova:owner>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:user uuid="a6db6c1120b74ffbb1bf354c509d27ec">tempest-ServerActionsTestOtherA-1163059526-project-member</nova:user>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:project uuid="44597afe7d404702983ba1555116e936">tempest-ServerActionsTestOtherA-1163059526</nova:project>
Aug 17 10:25:32 user nova-compute[73158]:       </nova:owner>
Aug 17 10:25:32 user nova-compute[73158]:       <nova:ports>
Aug 17 10:25:32 user nova-compute[73158]:         <nova:port uuid="575c37dd-5734-46db-9e11-58ff9dd0b1e0">
Aug 17 10:25:32 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:25:32 user nova-compute[73158]:         </nova:port>
Aug 17 10:25:32 user nova-compute[73158]:       </nova:ports>
Aug 17 10:25:32 user nova-compute[73158]:     </nova:instance>
Aug 17 10:25:32 user nova-compute[73158]:   </metadata>
Aug 17 10:25:32 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:25:32 user nova-compute[73158]:     <system>
Aug 17 10:25:32 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:25:32 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:25:32 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:25:32 user nova-compute[73158]:       <entry name="serial">008cc48e-5db1-4f5d-b133-e9577cabe4f8</entry>
Aug 17 10:25:32 user nova-compute[73158]:       <entry name="uuid">008cc48e-5db1-4f5d-b133-e9577cabe4f8</entry>
Aug 17 10:25:32 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:25:32 user nova-compute[73158]:     </system>
Aug 17 10:25:32 user nova-compute[73158]:   </sysinfo>
Aug 17 10:25:32 user nova-compute[73158]:   <os>
Aug 17 10:25:32 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:25:32 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:25:32 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:25:32 user nova-compute[73158]:   </os>
Aug 17 10:25:32 user nova-compute[73158]:   <features>
Aug 17 10:25:32 user nova-compute[73158]:     <acpi/>
Aug 17 10:25:32 user nova-compute[73158]:     <apic/>
Aug 17 10:25:32 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:25:32 user nova-compute[73158]:   </features>
Aug 17 10:25:32 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:25:32 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:25:32 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:25:32 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:25:32 user nova-compute[73158]:   </clock>
Aug 17 10:25:32 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:25:32 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:25:32 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:25:32 user nova-compute[73158]:   </cpu>
Aug 17 10:25:32 user nova-compute[73158]:   <devices>
Aug 17 10:25:32 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:25:32 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:25:32 user nova-compute[73158]:       <source dev="/dev/sdd"/>
Aug 17 10:25:32 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:25:32 user nova-compute[73158]:       <serial>a2c59f99-32ec-4481-a8d8-85031cc5dfef</serial>
Aug 17 10:25:32 user nova-compute[73158]:     </disk>
Aug 17 10:25:32 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:25:32 user nova-compute[73158]:       <mac address="fa:16:3e:58:e0:cd"/>
Aug 17 10:25:32 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:25:32 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:25:32 user nova-compute[73158]:       <target dev="tap575c37dd-57"/>
Aug 17 10:25:32 user nova-compute[73158]:     </interface>
Aug 17 10:25:32 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:25:32 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/008cc48e-5db1-4f5d-b133-e9577cabe4f8/console.log" append="off"/>
Aug 17 10:25:32 user nova-compute[73158]:     </serial>
Aug 17 10:25:32 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:25:32 user nova-compute[73158]:     <video>
Aug 17 10:25:32 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:25:32 user nova-compute[73158]:     </video>
Aug 17 10:25:32 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:25:32 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:25:32 user nova-compute[73158]:     </rng>
Aug 17 10:25:32 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:25:32 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:25:32 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:25:32 user nova-compute[73158]:     </memballoon>
Aug 17 10:25:32 user nova-compute[73158]:   </devices>
Aug 17 10:25:32 user nova-compute[73158]: </domain>
Aug 17 10:25:32 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-796905679',display_name='tempest-ServerActionsTestOtherA-server-796905679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-796905679',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-5t2q7aa8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=008cc48e-5db1-4f5d-b133-e9577cabe4f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-777600357-network", "vif_mac": "fa:16:3e:58:e0:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG os_vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap575c37dd-57, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap575c37dd-57, col_values=(('external_ids', {'iface-id': '575c37dd-5734-46db-9e11-58ff9dd0b1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:e0:cd', 'vm-uuid': '008cc48e-5db1-4f5d-b133-e9577cabe4f8'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:32 user nova-compute[73158]: INFO os_vif [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57')
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:25:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] No VIF found with MAC fa:16:3e:58:e0:cd, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-2de7e96a-986f-4483-8d5e-7b8b81cc03e3 req-b0b66e75-c1d6-4cc4-962d-317eff98fae3 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2de7e96a-986f-4483-8d5e-7b8b81cc03e3 req-b0b66e75-c1d6-4cc4-962d-317eff98fae3 service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2de7e96a-986f-4483-8d5e-7b8b81cc03e3 req-b0b66e75-c1d6-4cc4-962d-317eff98fae3 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2de7e96a-986f-4483-8d5e-7b8b81cc03e3 req-b0b66e75-c1d6-4cc4-962d-317eff98fae3 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG nova.compute.manager [req-2de7e96a-986f-4483-8d5e-7b8b81cc03e3 req-b0b66e75-c1d6-4cc4-962d-317eff98fae3 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:34 user nova-compute[73158]: WARNING nova.compute.manager [req-2de7e96a-986f-4483-8d5e-7b8b81cc03e3 req-b0b66e75-c1d6-4cc4-962d-317eff98fae3 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state active and task_state resize_finish.
Aug 17 10:25:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267936.2270222, 008cc48e-5db1-4f5d-b133-e9577cabe4f8 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] VM Resumed (Lifecycle Event)
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267921.526371, 19672aa4-812e-4a2f-8d96-002fa79b708f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] VM Stopped (Lifecycle Event)
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-523ccb6e-bd9a-40f6-8eae-199b473d4729 req-da59ca16-e11d-400a-bfbd-59166644a500 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-523ccb6e-bd9a-40f6-8eae-199b473d4729 req-da59ca16-e11d-400a-bfbd-59166644a500 service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-523ccb6e-bd9a-40f6-8eae-199b473d4729 req-da59ca16-e11d-400a-bfbd-59166644a500 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-523ccb6e-bd9a-40f6-8eae-199b473d4729 req-da59ca16-e11d-400a-bfbd-59166644a500 service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-523ccb6e-bd9a-40f6-8eae-199b473d4729 req-da59ca16-e11d-400a-bfbd-59166644a500 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:25:36 user nova-compute[73158]: WARNING nova.compute.manager [req-523ccb6e-bd9a-40f6-8eae-199b473d4729 req-da59ca16-e11d-400a-bfbd-59166644a500 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state active and task_state resize_finish.
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c17b0910-38c8-4713-8f3d-f1b7bd6796de None None] [instance: 19672aa4-812e-4a2f-8d96-002fa79b708f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:25:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7223MB free_disk=24.000804901123047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance running successfully.
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Failed to set time: agent not configured {{(pid=73158) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-76e0ba24-f37e-43a3-b057-d4af0edef1cf tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] finish_migration finished successfully. {{(pid=73158) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267936.2302737, 008cc48e-5db1-4f5d-b133-e9577cabe4f8 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] VM Started (Lifecycle Event)
Aug 17 10:25:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Applying migration context for instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 as it has an incoming, in-progress migration e9085077-8046-4c75-a716-5ce982c8e3c6. Migration status is finished {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 10:25:36 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating resource usage from migration e9085077-8046-4c75-a716-5ce982c8e3c6
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance d2dbefd6-afaf-4446-977f-69c0ead85a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Migration e9085077-8046-4c75-a716-5ce982c8e3c6 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:25:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267922.4844625, a6744f73-a7ec-4388-8e15-c05068041a09 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:25:37 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Stopped (Lifecycle Event)
Aug 17 10:25:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fafe5688-1493-49d3-b996-657b1b8c54c0 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-fafe5688-1493-49d3-b996-657b1b8c54c0 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:25:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:25:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:40 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fb0b8a-93ab-412c-a7d6-6e75890c777f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:25:40 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a43cf70-f99b-48bf-9a1d-b2dfd9b3a23e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78] added
Aug 17 10:25:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa0bff-af5e-4495-ba2f-426be415fa39]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d10f8-0a64-4019-a8d7-f3c359fac45f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDxXwfYu {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDxXwfYu" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a3a65b-b7a9-41b8-916b-7ddaae85ade9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDxXwfYu'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab032e-cd86-4246-8c9c-a43c08d65aea]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce2515-15a2-45f2-a586-5a38fee191a9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c27446-e302-465a-9e21-9ead64aa96b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]
Aug 17 10:25:40 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.
Aug 17 10:25:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e956ef3-fceb-49ec-aa7b-a1a944b8d8e9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2930b229-075f-4b57-a8b1-95efd4c0f768]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:40 user nova-compute[73158]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:25:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef5285-86a4-42c2-9634-af312aad9974]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23766356233396164', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766356233396164', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'flavor' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:25:41 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:25:41 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:25:41 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:25:41 user nova-compute[73158]:   <serial>7e0fd4a4-23c9-481c-8ffc-1717a3940a78</serial>
Aug 17 10:25:41 user nova-compute[73158]: </disk>
Aug 17 10:25:41 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:25:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:25:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:25:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No VIF found with MAC fa:16:3e:6e:1d:71, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:25:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5fec4e72-e2da-482f-afcc-96edcf79d4d8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.900s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:25:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing instance network info cache due to event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:51 user nova-compute[73158]: DEBUG nova.network.neutron [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:25:52 user nova-compute[73158]: INFO nova.compute.manager [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Detaching volume d5845dd9-f0e3-439f-8630-6fc85f0748d0
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.network.neutron [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updated VIF entry in instance network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.network.neutron [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-59664221-459a-49da-bd38-f75cfd17e45d req-2cfaf28e-d4fb-4721-bcdf-c2c918d4952a service nova] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:52 user nova-compute[73158]: INFO nova.virt.block_device [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Attempting to driver detach volume d5845dd9-f0e3-439f-8630-6fc85f0748d0 from mountpoint /dev/vdb
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Attempting to detach device vdb from instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:25:52 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:25:52 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:25:52 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:25:52 user nova-compute[73158]:   <serial>d5845dd9-f0e3-439f-8630-6fc85f0748d0</serial>
Aug 17 10:25:52 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:25:52 user nova-compute[73158]: </disk>
Aug 17 10:25:52 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:25:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully detached device vdb from instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 from the persistent domain config.
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:25:52 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:25:52 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:25:52 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:25:52 user nova-compute[73158]:   <serial>d5845dd9-f0e3-439f-8630-6fc85f0748d0</serial>
Aug 17 10:25:52 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:25:52 user nova-compute[73158]: </disk>
Aug 17 10:25:52 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692267952.9422026, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:25:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully detached device vdb from instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 from the live domain config.
Aug 17 10:25:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMajStsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:25:52 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:25:52 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce23d195-39b3-492a-84e4-fcb7a17369f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[583a33e9-9be3-4dbc-a885-bfb963203458]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:25:53 user nova-compute[73158]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:25:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c2ca9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0'): ({'sde'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Removing single pathed devices sde {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f45c3-143c-4094-835c-7f02caf19502]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b593a5b-98c9-4d2a-8717-b3b23aa67d04]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Flushing IO for device /dev/sde {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914e9c0-646f-4016-a7ae-2041f5cb9c3e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6638c0-0ad3-4936-9c1b-4a270e2cfee5]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82136ff-6069-40c6-a01f-21660d7207e0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fad580-c9e7-44cc-86c6-565134c2fae0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260]
Aug 17 10:25:53 user nova-compute[73158]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0, portal: 172.16.0.220,3260] successful.
Aug 17 10:25:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5845dd9-f0e3-439f-8630-6fc85f0748d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db4711b-b695-4993-8214-b484779f9577]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] <== disconnect_volume: return (299ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing instance network info cache due to event network-changed-7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] Acquiring lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] Acquired lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Refreshing network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:54 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'flavor' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:25:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0cb224aa-9db0-49a1-8d64-f32e53dd1a8a tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.936s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:25:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updated VIF entry in instance network info cache for port 7e6a648c-93b5-4e7e-956d-ee5de80ca939. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [{"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f63e7f19-e8b2-4083-af98-36e749f2fcbb req-b1d1b91a-161f-4894-a3e0-68e2b890216c service nova] Releasing lock "refresh_cache-447f35f1-f3c6-4f5e-96e7-19399846c8f0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing instance network info cache due to event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG nova.network.neutron [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG nova.network.neutron [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updated VIF entry in instance network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG nova.network.neutron [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b4627165-58a8-4dec-8801-863edbec6b41 req-10e164aa-23ca-49fd-a09d-310605c8ecd0 service nova] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:25:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing instance network info cache due to event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updated VIF entry in instance network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:25:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8f165eb8-dadd-403a-87d4-c2947e184666 req-8be5149b-d720-4183-96da-5ad94ace23e7 service nova] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:05 user nova-compute[73158]: INFO nova.compute.manager [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Rebooting instance
Aug 17 10:26:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:26:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:26:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-686de9a3-e2fe-4c3b-9dad-436b43a0b4dc req-1f61af15-012d-400f-8f7b-24a36978ff74 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-unplugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-686de9a3-e2fe-4c3b-9dad-436b43a0b4dc req-1f61af15-012d-400f-8f7b-24a36978ff74 service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-686de9a3-e2fe-4c3b-9dad-436b43a0b4dc req-1f61af15-012d-400f-8f7b-24a36978ff74 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-686de9a3-e2fe-4c3b-9dad-436b43a0b4dc req-1f61af15-012d-400f-8f7b-24a36978ff74 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-686de9a3-e2fe-4c3b-9dad-436b43a0b4dc req-1f61af15-012d-400f-8f7b-24a36978ff74 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-unplugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:06 user nova-compute[73158]: WARNING nova.compute.manager [req-686de9a3-e2fe-4c3b-9dad-436b43a0b4dc req-1f61af15-012d-400f-8f7b-24a36978ff74 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-unplugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 10:26:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance destroyed successfully.
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'resources' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-587024482',display_name='tempest-TestMinimumBasicScenario-server-587024482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-587024482',id=29,image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8FVbmx+kb9yEUO9ShiA8PDyvF3awL3M5GGHQMeJ6cvLiCiq2GvBkb4I6zdhk86CKHLLxrbVf+Xuafinn96NHTuiqljroLITC4F5jmg4zNK93DW3UdMVk4mp66Y2ngJpQ==',key_name='tempest-TestMinimumBasicScenario-252178196',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-p22xgs3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:26:06Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=18c69e67-2459-4e44-b6cb-0321b02259a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00e0222d-04, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:07 user nova-compute[73158]: INFO os_vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04')
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:26:07 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d2639-8bc1-4108-bc5e-96b3e9592b09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1427a-4d55-4f6d-a6e7-4e8aa3f5d858]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3410c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d2c0b8-96ef-4ddd-a757-52d24d5a6d94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ac0a51-e3df-45fc-8910-ac87b6450b72]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db759a-a18d-4dfa-85f5-ee9e4a342b99]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffabdda9-7ba5-40c7-abee-22c82a218ea2]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e815dc-7375-45cd-990c-f1bcd0be98a8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15206bf-9238-4745-af07-2c70ca5ddd9f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]
Aug 17 10:26:07 user nova-compute[73158]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb49149-73e6-434b-ba58-61448edf4ff2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== disconnect_volume: return (326ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Start _get_guest_xml network_info=[{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=461989d1-6cc1-4277-a439-b06c387cdaa1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '461989d1-6cc1-4277-a439-b06c387cdaa1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': 'dae02c7d-517c-4a99-9f44-33828489860a', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '18c69e67-2459-4e44-b6cb-0321b02259a3', 'attached_at': '', 'detached_at': '', 'volume_id': '7e0fd4a4-23c9-481c-8ffc-1717a3940a78', 'serial': '7e0fd4a4-23c9-481c-8ffc-1717a3940a78'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:26:07 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:26:07 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=461989d1-6cc1-4277-a439-b06c387cdaa1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:26:07 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:26:07 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:26:07 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbccf460-b64d-4482-8111-244a2abd3af0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:26:07 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11e6e13-6ae1-4a7d-8e85-56a102e45641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78] added
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4d7d36-2654-457d-a928-aa32e38ecfd8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced82f5-c567-4dda-b2d6-b96df33b69c6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDxXwfYu {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDxXwfYu" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e32fb95-bbeb-43d8-87c3-c2657c130708]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDxXwfYu'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc706d-28f2-4f93-aec2-b2223cda8ab9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbacc57-ae3a-4eab-baf5-dc85a70e1c53]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5fc34f-ec71-49ce-a921-69a5ef2f2e58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]
Aug 17 10:26:07 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5084c0f6-b84c-4f96-9238-5b3aea33396b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac76849-b48f-49b1-b66a-06ce4f58cfff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:07 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:26:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:26:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d972b0-76b5-4b2d-91fe-1000a4ee2db1]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-66f42929-fc39-4b0c-b924-00962651ba23 req-f079514a-99f9-4e27-9632-4a3cac9d0fa8 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-66f42929-fc39-4b0c-b924-00962651ba23 req-f079514a-99f9-4e27-9632-4a3cac9d0fa8 service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-66f42929-fc39-4b0c-b924-00962651ba23 req-f079514a-99f9-4e27-9632-4a3cac9d0fa8 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-66f42929-fc39-4b0c-b924-00962651ba23 req-f079514a-99f9-4e27-9632-4a3cac9d0fa8 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-66f42929-fc39-4b0c-b924-00962651ba23 req-f079514a-99f9-4e27-9632-4a3cac9d0fa8 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:08 user nova-compute[73158]: WARNING nova.compute.manager [req-66f42929-fc39-4b0c-b924-00962651ba23 req-f079514a-99f9-4e27-9632-4a3cac9d0fa8 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 10:26:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23766356233396164', 'path': '/dev/sde'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766356233396164', 'path': '/dev/sde'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-587024482',display_name='tempest-TestMinimumBasicScenario-server-587024482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-587024482',id=29,image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8FVbmx+kb9yEUO9ShiA8PDyvF3awL3M5GGHQMeJ6cvLiCiq2GvBkb4I6zdhk86CKHLLxrbVf+Xuafinn96NHTuiqljroLITC4F5jmg4zNK93DW3UdMVk4mp66Y2ngJpQ==',key_name='tempest-TestMinimumBasicScenario-252178196',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-p22xgs3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:26:06Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=18c69e67-2459-4e44-b6cb-0321b02259a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'pci_devices' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:26:09 user nova-compute[73158]:   <uuid>18c69e67-2459-4e44-b6cb-0321b02259a3</uuid>
Aug 17 10:26:09 user nova-compute[73158]:   <name>instance-0000001d</name>
Aug 17 10:26:09 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:26:09 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:26:09 user nova-compute[73158]:   <metadata>
Aug 17 10:26:09 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:26:09 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:26:09 user nova-compute[73158]:       <nova:name>tempest-TestMinimumBasicScenario-server-587024482</nova:name>
Aug 17 10:26:09 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:26:07</nova:creationTime>
Aug 17 10:26:09 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:26:09 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:26:09 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:26:09 user nova-compute[73158]:       <nova:owner>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:user uuid="b9e11c73731047a6990c618c2f7fe6a2">tempest-TestMinimumBasicScenario-1702191441-project-member</nova:user>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:project uuid="beeb69e4c9da4d2d9403e97e35033f1a">tempest-TestMinimumBasicScenario-1702191441</nova:project>
Aug 17 10:26:09 user nova-compute[73158]:       </nova:owner>
Aug 17 10:26:09 user nova-compute[73158]:       <nova:root type="image" uuid="461989d1-6cc1-4277-a439-b06c387cdaa1"/>
Aug 17 10:26:09 user nova-compute[73158]:       <nova:ports>
Aug 17 10:26:09 user nova-compute[73158]:         <nova:port uuid="00e0222d-048b-4880-a9e1-0c4dec6749e8">
Aug 17 10:26:09 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:26:09 user nova-compute[73158]:         </nova:port>
Aug 17 10:26:09 user nova-compute[73158]:       </nova:ports>
Aug 17 10:26:09 user nova-compute[73158]:     </nova:instance>
Aug 17 10:26:09 user nova-compute[73158]:   </metadata>
Aug 17 10:26:09 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:26:09 user nova-compute[73158]:     <system>
Aug 17 10:26:09 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:26:09 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:26:09 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:26:09 user nova-compute[73158]:       <entry name="serial">18c69e67-2459-4e44-b6cb-0321b02259a3</entry>
Aug 17 10:26:09 user nova-compute[73158]:       <entry name="uuid">18c69e67-2459-4e44-b6cb-0321b02259a3</entry>
Aug 17 10:26:09 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:26:09 user nova-compute[73158]:     </system>
Aug 17 10:26:09 user nova-compute[73158]:   </sysinfo>
Aug 17 10:26:09 user nova-compute[73158]:   <os>
Aug 17 10:26:09 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:26:09 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:26:09 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:26:09 user nova-compute[73158]:   </os>
Aug 17 10:26:09 user nova-compute[73158]:   <features>
Aug 17 10:26:09 user nova-compute[73158]:     <acpi/>
Aug 17 10:26:09 user nova-compute[73158]:     <apic/>
Aug 17 10:26:09 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:26:09 user nova-compute[73158]:   </features>
Aug 17 10:26:09 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:26:09 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:26:09 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:26:09 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:26:09 user nova-compute[73158]:   </clock>
Aug 17 10:26:09 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:26:09 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:26:09 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:26:09 user nova-compute[73158]:   </cpu>
Aug 17 10:26:09 user nova-compute[73158]:   <devices>
Aug 17 10:26:09 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:26:09 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:26:09 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk"/>
Aug 17 10:26:09 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:26:09 user nova-compute[73158]:     </disk>
Aug 17 10:26:09 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:26:09 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:26:09 user nova-compute[73158]:       <source dev="/dev/sde"/>
Aug 17 10:26:09 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:26:09 user nova-compute[73158]:       <serial>7e0fd4a4-23c9-481c-8ffc-1717a3940a78</serial>
Aug 17 10:26:09 user nova-compute[73158]:     </disk>
Aug 17 10:26:09 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:26:09 user nova-compute[73158]:       <mac address="fa:16:3e:6e:1d:71"/>
Aug 17 10:26:09 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:26:09 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:26:09 user nova-compute[73158]:       <target dev="tap00e0222d-04"/>
Aug 17 10:26:09 user nova-compute[73158]:     </interface>
Aug 17 10:26:09 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:26:09 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/console.log" append="off"/>
Aug 17 10:26:09 user nova-compute[73158]:     </serial>
Aug 17 10:26:09 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:26:09 user nova-compute[73158]:     <video>
Aug 17 10:26:09 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:26:09 user nova-compute[73158]:     </video>
Aug 17 10:26:09 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:26:09 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:26:09 user nova-compute[73158]:     </rng>
Aug 17 10:26:09 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:26:09 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:26:09 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:26:09 user nova-compute[73158]:     </memballoon>
Aug 17 10:26:09 user nova-compute[73158]:   </devices>
Aug 17 10:26:09 user nova-compute[73158]: </domain>
Aug 17 10:26:09 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Cannot resize image /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'migration_context' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-587024482',display_name='tempest-TestMinimumBasicScenario-server-587024482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-587024482',id=29,image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8FVbmx+kb9yEUO9ShiA8PDyvF3awL3M5GGHQMeJ6cvLiCiq2GvBkb4I6zdhk86CKHLLxrbVf+Xuafinn96NHTuiqljroLITC4F5jmg4zNK93DW3UdMVk4mp66Y2ngJpQ==',key_name='tempest-TestMinimumBasicScenario-252178196',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-p22xgs3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:26:06Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=18c69e67-2459-4e44-b6cb-0321b02259a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG os_vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00e0222d-04, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00e0222d-04, col_values=(('external_ids', {'iface-id': '00e0222d-048b-4880-a9e1-0c4dec6749e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1d:71', 'vm-uuid': '18c69e67-2459-4e44-b6cb-0321b02259a3'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:26:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:10 user nova-compute[73158]: INFO os_vif [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04')
Aug 17 10:26:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-daca917f-9508-41c1-b06d-913b463eb78b req-cbeb3272-6730-4f02-91dc-70b40013a203 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daca917f-9508-41c1-b06d-913b463eb78b req-cbeb3272-6730-4f02-91dc-70b40013a203 service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daca917f-9508-41c1-b06d-913b463eb78b req-cbeb3272-6730-4f02-91dc-70b40013a203 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daca917f-9508-41c1-b06d-913b463eb78b req-cbeb3272-6730-4f02-91dc-70b40013a203 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-daca917f-9508-41c1-b06d-913b463eb78b req-cbeb3272-6730-4f02-91dc-70b40013a203 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:11 user nova-compute[73158]: WARNING nova.compute.manager [req-daca917f-9508-41c1-b06d-913b463eb78b req-cbeb3272-6730-4f02-91dc-70b40013a203 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 10:26:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 18c69e67-2459-4e44-b6cb-0321b02259a3 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267973.7857764, 18c69e67-2459-4e44-b6cb-0321b02259a3 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] VM Resumed (Lifecycle Event)
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:26:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance rebooted successfully.
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:26:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267973.7881684, 18c69e67-2459-4e44-b6cb-0321b02259a3 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:13 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] VM Started (Lifecycle Event)
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-f91e96c5-88e6-4850-8ab4-ffeae2cd37fd req-250e7c8f-ef72-45b6-9818-fa476e0d331a service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f91e96c5-88e6-4850-8ab4-ffeae2cd37fd req-250e7c8f-ef72-45b6-9818-fa476e0d331a service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f91e96c5-88e6-4850-8ab4-ffeae2cd37fd req-250e7c8f-ef72-45b6-9818-fa476e0d331a service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f91e96c5-88e6-4850-8ab4-ffeae2cd37fd req-250e7c8f-ef72-45b6-9818-fa476e0d331a service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-f91e96c5-88e6-4850-8ab4-ffeae2cd37fd req-250e7c8f-ef72-45b6-9818-fa476e0d331a service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:13 user nova-compute[73158]: WARNING nova.compute.manager [req-f91e96c5-88e6-4850-8ab4-ffeae2cd37fd req-250e7c8f-ef72-45b6-9818-fa476e0d331a service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 10:26:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:26:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1a8105c-707a-4f21-afb9-5ff378cec44b tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.302s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:21 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:26:21 user nova-compute[73158]: INFO nova.compute.claims [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Claim successful on node user
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:26:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.policy [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffd30bbc5964c5abf76e663dcd4f38f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d1716206474e9793bc7d5ccc1c46a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:26:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Creating image(s)
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "/opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "/opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "/opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:22 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk 1073741824" returned: 0 in 0.062s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Successfully created port: cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Cannot resize image /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG nova.objects.instance [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lazy-loading 'migration_context' on Instance uuid 10c7414f-40f2-46f4-aa1e-e8d8516d0329 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Ensure instance console log exists: /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Successfully updated port: cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "refresh_cache-10c7414f-40f2-46f4-aa1e-e8d8516d0329" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquired lock "refresh_cache-10c7414f-40f2-46f4-aa1e-e8d8516d0329" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-changed-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Refreshing instance network info cache due to event network-changed-cfbdf6df-2711-457a-ad8b-ece8d3c1438c. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] Acquiring lock "refresh_cache-10c7414f-40f2-46f4-aa1e-e8d8516d0329" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Updating instance_info_cache with network_info: [{"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Releasing lock "refresh_cache-10c7414f-40f2-46f4-aa1e-e8d8516d0329" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Instance network_info: |[{"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] Acquired lock "refresh_cache-10c7414f-40f2-46f4-aa1e-e8d8516d0329" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.neutron [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Refreshing network info cache for port cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Start _get_guest_xml network_info=[{"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:26:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:26:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1757296826',display_name='tempest-VolumesActionsTest-instance-1757296826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1757296826',id=32,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d1716206474e9793bc7d5ccc1c46a7',ramdisk_id='',reservation_id='r-ekks4102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-401914087',owner_user_name='tempest-VolumesActionsTest-401914087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:26:23Z,user_data=None,user_id='8ffd30bbc5964c5abf76e663dcd4f38f',uuid=10c7414f-40f2-46f4-aa1e-e8d8516d0329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Converting VIF {"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lazy-loading 'pci_devices' on Instance uuid 10c7414f-40f2-46f4-aa1e-e8d8516d0329 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:26:24 user nova-compute[73158]:   <uuid>10c7414f-40f2-46f4-aa1e-e8d8516d0329</uuid>
Aug 17 10:26:24 user nova-compute[73158]:   <name>instance-00000020</name>
Aug 17 10:26:24 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:26:24 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:26:24 user nova-compute[73158]:   <metadata>
Aug 17 10:26:24 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:26:24 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:26:24 user nova-compute[73158]:       <nova:name>tempest-VolumesActionsTest-instance-1757296826</nova:name>
Aug 17 10:26:24 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:26:24</nova:creationTime>
Aug 17 10:26:24 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:26:24 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:26:24 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:26:24 user nova-compute[73158]:       <nova:owner>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:user uuid="8ffd30bbc5964c5abf76e663dcd4f38f">tempest-VolumesActionsTest-401914087-project-member</nova:user>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:project uuid="67d1716206474e9793bc7d5ccc1c46a7">tempest-VolumesActionsTest-401914087</nova:project>
Aug 17 10:26:24 user nova-compute[73158]:       </nova:owner>
Aug 17 10:26:24 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:26:24 user nova-compute[73158]:       <nova:ports>
Aug 17 10:26:24 user nova-compute[73158]:         <nova:port uuid="cfbdf6df-2711-457a-ad8b-ece8d3c1438c">
Aug 17 10:26:24 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 10:26:24 user nova-compute[73158]:         </nova:port>
Aug 17 10:26:24 user nova-compute[73158]:       </nova:ports>
Aug 17 10:26:24 user nova-compute[73158]:     </nova:instance>
Aug 17 10:26:24 user nova-compute[73158]:   </metadata>
Aug 17 10:26:24 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:26:24 user nova-compute[73158]:     <system>
Aug 17 10:26:24 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:26:24 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:26:24 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:26:24 user nova-compute[73158]:       <entry name="serial">10c7414f-40f2-46f4-aa1e-e8d8516d0329</entry>
Aug 17 10:26:24 user nova-compute[73158]:       <entry name="uuid">10c7414f-40f2-46f4-aa1e-e8d8516d0329</entry>
Aug 17 10:26:24 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:26:24 user nova-compute[73158]:     </system>
Aug 17 10:26:24 user nova-compute[73158]:   </sysinfo>
Aug 17 10:26:24 user nova-compute[73158]:   <os>
Aug 17 10:26:24 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:26:24 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:26:24 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:26:24 user nova-compute[73158]:   </os>
Aug 17 10:26:24 user nova-compute[73158]:   <features>
Aug 17 10:26:24 user nova-compute[73158]:     <acpi/>
Aug 17 10:26:24 user nova-compute[73158]:     <apic/>
Aug 17 10:26:24 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:26:24 user nova-compute[73158]:   </features>
Aug 17 10:26:24 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:26:24 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:26:24 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:26:24 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:26:24 user nova-compute[73158]:   </clock>
Aug 17 10:26:24 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:26:24 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:26:24 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:26:24 user nova-compute[73158]:   </cpu>
Aug 17 10:26:24 user nova-compute[73158]:   <devices>
Aug 17 10:26:24 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:26:24 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:26:24 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk"/>
Aug 17 10:26:24 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:26:24 user nova-compute[73158]:     </disk>
Aug 17 10:26:24 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:26:24 user nova-compute[73158]:       <mac address="fa:16:3e:cb:8a:75"/>
Aug 17 10:26:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:26:24 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:26:24 user nova-compute[73158]:       <target dev="tapcfbdf6df-27"/>
Aug 17 10:26:24 user nova-compute[73158]:     </interface>
Aug 17 10:26:24 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:26:24 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/console.log" append="off"/>
Aug 17 10:26:24 user nova-compute[73158]:     </serial>
Aug 17 10:26:24 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:26:24 user nova-compute[73158]:     <video>
Aug 17 10:26:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:26:24 user nova-compute[73158]:     </video>
Aug 17 10:26:24 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:26:24 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:26:24 user nova-compute[73158]:     </rng>
Aug 17 10:26:24 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:26:24 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:26:24 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:26:24 user nova-compute[73158]:     </memballoon>
Aug 17 10:26:24 user nova-compute[73158]:   </devices>
Aug 17 10:26:24 user nova-compute[73158]: </domain>
Aug 17 10:26:24 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1757296826',display_name='tempest-VolumesActionsTest-instance-1757296826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1757296826',id=32,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d1716206474e9793bc7d5ccc1c46a7',ramdisk_id='',reservation_id='r-ekks4102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-401914087',owner_user_name='tempest-VolumesActionsTest-401914087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:26:23Z,user_data=None,user_id='8ffd30bbc5964c5abf76e663dcd4f38f',uuid=10c7414f-40f2-46f4-aa1e-e8d8516d0329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Converting VIF {"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG os_vif [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfbdf6df-27, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfbdf6df-27, col_values=(('external_ids', {'iface-id': 'cfbdf6df-2711-457a-ad8b-ece8d3c1438c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:8a:75', 'vm-uuid': '10c7414f-40f2-46f4-aa1e-e8d8516d0329'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:24 user nova-compute[73158]: INFO os_vif [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27')
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:26:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] No VIF found with MAC fa:16:3e:cb:8a:75, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:26:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Updated VIF entry in instance network info cache for port cfbdf6df-2711-457a-ad8b-ece8d3c1438c. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:26:25 user nova-compute[73158]: DEBUG nova.network.neutron [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Updating instance_info_cache with network_info: [{"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3bae8cc4-7a17-4cc5-928f-fb8b09b1944d req-74c53541-1486-4c13-a67f-867a2f4c8b4f service nova] Releasing lock "refresh_cache-10c7414f-40f2-46f4-aa1e-e8d8516d0329" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-changed-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Refreshing instance network info cache due to event network-changed-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] Acquiring lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] Acquired lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.network.neutron [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Refreshing network info cache for port e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:26 user nova-compute[73158]: INFO nova.compute.manager [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Terminating instance
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-282aafd1-d05c-452b-aa9c-6f6c482a7fcf req-8ae93a80-840b-4e21-81b2-fee5145bbcd3 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-vif-unplugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-282aafd1-d05c-452b-aa9c-6f6c482a7fcf req-8ae93a80-840b-4e21-81b2-fee5145bbcd3 service nova] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-282aafd1-d05c-452b-aa9c-6f6c482a7fcf req-8ae93a80-840b-4e21-81b2-fee5145bbcd3 service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-282aafd1-d05c-452b-aa9c-6f6c482a7fcf req-8ae93a80-840b-4e21-81b2-fee5145bbcd3 service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-282aafd1-d05c-452b-aa9c-6f6c482a7fcf req-8ae93a80-840b-4e21-81b2-fee5145bbcd3 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] No waiting events found dispatching network-vif-unplugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-282aafd1-d05c-452b-aa9c-6f6c482a7fcf req-8ae93a80-840b-4e21-81b2-fee5145bbcd3 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-vif-unplugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-be036619-1b12-4543-9bec-a9ed77e194eb req-49261c56-400c-439f-a927-f0f72af38e5d service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-be036619-1b12-4543-9bec-a9ed77e194eb req-49261c56-400c-439f-a927-f0f72af38e5d service nova] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-be036619-1b12-4543-9bec-a9ed77e194eb req-49261c56-400c-439f-a927-f0f72af38e5d service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-be036619-1b12-4543-9bec-a9ed77e194eb req-49261c56-400c-439f-a927-f0f72af38e5d service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-be036619-1b12-4543-9bec-a9ed77e194eb req-49261c56-400c-439f-a927-f0f72af38e5d service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] No waiting events found dispatching network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:26 user nova-compute[73158]: WARNING nova.compute.manager [req-be036619-1b12-4543-9bec-a9ed77e194eb req-49261c56-400c-439f-a927-f0f72af38e5d service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received unexpected event network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c for instance with vm_state building and task_state spawning.
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Instance destroyed successfully.
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.objects.instance [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lazy-loading 'resources' on Instance uuid d2dbefd6-afaf-4446-977f-69c0ead85a01 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-254226682',display_name='tempest-TestStampPattern-server-254226682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-254226682',id=22,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6XIxP0dCINXqjELSrLNjFiRC+1PldH0AChmBMJ5HNVC3DRW7UR8eVYRzITonCUhH/MtY84G5Nh9wiITQ8XKcYuD0UbRRpWG4DHpqdPsono5MbPBjUhIFJKYjWAejQNwg==',key_name='tempest-TestStampPattern-863239552',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf8d6d6113124771be6093c99e106c18',ramdisk_id='',reservation_id='r-zaams6cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1495454869',owner_user_name='tempest-TestStampPattern-1495454869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:22:18Z,user_data=None,user_id='908f0da6a47c4ba295fee97cf4e88234',uuid=d2dbefd6-afaf-4446-977f-69c0ead85a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converting VIF {"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG os_vif [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7e169e7-a1, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: INFO os_vif [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:7d:53,bridge_name='br-int',has_traffic_filtering=True,id=e7e169e7-a1ff-486a-b2f5-ef7ef823dd64,network=Network(b06a2fb7-0800-4a76-86f5-1ef26bb77b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e169e7-a1')
Aug 17 10:26:27 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Deleting instance files /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01_del
Aug 17 10:26:27 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Deletion of /opt/stack/data/nova/instances/d2dbefd6-afaf-4446-977f-69c0ead85a01_del complete
Aug 17 10:26:27 user nova-compute[73158]: INFO nova.compute.manager [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.network.neutron [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updated VIF entry in instance network info cache for port e7e169e7-a1ff-486a-b2f5-ef7ef823dd64. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.network.neutron [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updating instance_info_cache with network_info: [{"id": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "address": "fa:16:3e:34:7d:53", "network": {"id": "b06a2fb7-0800-4a76-86f5-1ef26bb77b90", "bridge": "br-int", "label": "tempest-TestStampPattern-1921133421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf8d6d6113124771be6093c99e106c18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e169e7-a1", "ovs_interfaceid": "e7e169e7-a1ff-486a-b2f5-ef7ef823dd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b7b6b85f-b444-44d7-909e-5e3449385fa9 req-4a61d285-d181-467c-9b57-a08200053578 service nova] Releasing lock "refresh_cache-d2dbefd6-afaf-4446-977f-69c0ead85a01" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:27 user nova-compute[73158]: INFO nova.compute.manager [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Terminating instance
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:27 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Took 0.66 seconds to deallocate network for instance.
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Instance destroyed successfully.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lazy-loading 'resources' on Instance uuid 4fe9c190-01f0-4d1c-af66-cd61aa8334ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1669003801',display_name='tempest-ServerActionsTestOtherB-server-1669003801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1669003801',id=19,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFS4kSK8RLtpWp4Ap1JyUuI1z8J6a/zFES840nsJOVvFY5WfWmbUNz6QNaQVCKMq4k/vcKOEtOjWr4GpdktNHnDwL0v3vT9fmmyHyo4ZKdwKyRyiX5byz5luIfy+mvxdA==',key_name='tempest-keypair-68975422',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7160dba7264083b524295f3d5028e8',ramdisk_id='',reservation_id='r-eeoz6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1114975532',owner_user_name='tempest-ServerActionsTestOtherB-1114975532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3434dc3b8af4c6dae565ddeb206e201',uuid=4fe9c190-01f0-4d1c-af66-cd61aa8334ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converting VIF {"id": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "address": "fa:16:3e:80:1e:65", "network": {"id": "fb244a35-ef43-4657-b503-dfb60e146bea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-178384429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7160dba7264083b524295f3d5028e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ea77-5e", "ovs_interfaceid": "94d3ea77-5eb2-4eaf-b0e8-150394cce1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_vif [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94d3ea77-5e, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:28 user nova-compute[73158]: INFO os_vif [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1e:65,bridge_name='br-int',has_traffic_filtering=True,id=94d3ea77-5eb2-4eaf-b0e8-150394cce1a2,network=Network(fb244a35-ef43-4657-b503-dfb60e146bea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d3ea77-5e')
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebjOowFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:26:28 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d478b692-132a-4558-a991-bb4f46bd161e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c90d1b-0531-4e16-b97d-3651ebd61eef]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:28 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:28 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:28 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:26:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:26:28 user nova-compute[73158]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 (non-flash)
Aug 17 10:26:28 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:26:28 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:26:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c47e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[35764213-13e1-46b6-bafe-3475ab91018b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[01101fd2-6126-4ebc-8464-865508830a39]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[576bbbaf-726a-40ed-82b3-2a4c51b0ba4d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abb0068-6914-4378-98d4-7937df7e01de]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Deleted allocations for instance d2dbefd6-afaf-4446-977f-69c0ead85a01
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6958c944-1ca3-4803-a345-3fa40a7d781c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267988.5766964, 10c7414f-40f2-46f4-aa1e-e8d8516d0329 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] VM Resumed (Lifecycle Event)
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Instance spawned successfully.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1eec4d-db67-4f56-8fe3-05a63e1d4818]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260]
Aug 17 10:26:28 user nova-compute[73158]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31, portal: 172.16.0.220,3260] successful.
Aug 17 10:26:28 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-672b0981-7dd8-4563-974b-0718a86e0469 tempest-TestStampPattern-1495454869 tempest-TestStampPattern-1495454869-project-member] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3474c7db-e686-4c34-9bd5-1ac0f576fd31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad719c59-6cc5-4241-90fb-f386cc8f5d2e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] <== disconnect_volume: return (334ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Deleting instance files /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee_del
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Deletion of /opt/stack/data/nova/instances/4fe9c190-01f0-4d1c-af66-cd61aa8334ee_del complete
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692267988.5783315, 10c7414f-40f2-46f4-aa1e-e8d8516d0329 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] VM Started (Lifecycle Event)
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Acquiring lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Lock "d2dbefd6-afaf-4446-977f-69c0ead85a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] No waiting events found dispatching network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:28 user nova-compute[73158]: WARNING nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received unexpected event network-vif-plugged-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 for instance with vm_state deleted and task_state None.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-unplugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Acquiring lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] No waiting events found dispatching network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:28 user nova-compute[73158]: WARNING nova.compute.manager [req-4a7db110-3e43-430b-87f8-008025dfae4f req-d6a43609-0652-4a7d-9ce9-daa55eb1839f service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received unexpected event network-vif-plugged-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 for instance with vm_state active and task_state deleting.
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] No waiting events found dispatching network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:28 user nova-compute[73158]: WARNING nova.compute.manager [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received unexpected event network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c for instance with vm_state building and task_state spawning.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-395e56a6-e1d2-41bc-8d91-9e2c49296fe1 req-8e58f818-8f09-4740-a44f-88fb52367d23 service nova] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Received event network-vif-deleted-e7e169e7-a1ff-486a-b2f5-ef7ef823dd64 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:26:28 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:26:28 user nova-compute[73158]: INFO nova.compute.manager [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Took 6.87 seconds to build instance.
Aug 17 10:26:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cee84ce3-d2e3-4706-b032-c9695cd8ad1f tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.972s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:29 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Took 0.89 seconds to deallocate network for instance.
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:30 user nova-compute[73158]: INFO nova.compute.manager [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Took 0.85 seconds to detach 1 volumes for instance.
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-75f923db-d068-4c25-83b7-cd2fefd304f3 req-5fe417b4-9d18-4146-8235-24f23f213e49 service nova] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Received event network-vif-deleted-94d3ea77-5eb2-4eaf-b0e8-150394cce1a2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:26:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:31 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Deleted allocations for instance 4fe9c190-01f0-4d1c-af66-cd61aa8334ee
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4db8c3eb-ae86-46ff-8602-c56a12f4e6e2 tempest-ServerActionsTestOtherB-1114975532 tempest-ServerActionsTestOtherB-1114975532-project-member] Lock "4fe9c190-01f0-4d1c-af66-cd61aa8334ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.815s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:34 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:26:34 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7204MB free_disk=24.13983154296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Applying migration context for instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 as it has an incoming, in-progress migration e9085077-8046-4c75-a716-5ce982c8e3c6. Migration status is finished {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 10:26:34 user nova-compute[73158]: INFO nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating resource usage from migration e9085077-8046-4c75-a716-5ce982c8e3c6
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Migration e9085077-8046-4c75-a716-5ce982c8e3c6 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 10c7414f-40f2-46f4-aa1e-e8d8516d0329 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:26:34 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:26:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:26:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updating instance_info_cache with network_info: [{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:26:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-changed-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Refreshing instance network info cache due to event network-changed-6ee15fce-fad3-4b26-8da7-a496a7da96c2. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] Acquiring lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] Acquired lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG nova.network.neutron [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Refreshing network info cache for port 6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG nova.network.neutron [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updated VIF entry in instance network info cache for port 6ee15fce-fad3-4b26-8da7-a496a7da96c2. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG nova.network.neutron [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updating instance_info_cache with network_info: [{"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-daccb4ee-3838-4fbf-94ba-03f7ebfdebb0 req-44d49e74-fc6e-415e-b22e-b090337388b0 service nova] Releasing lock "refresh_cache-65ca631c-9503-43e3-8b01-c350d9c1eb3e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:26:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:41 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267987.0688138, d2dbefd6-afaf-4446-977f-69c0ead85a01 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:42 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] VM Stopped (Lifecycle Event)
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:42 user nova-compute[73158]: INFO nova.compute.manager [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Attaching volume 29d13745-af82-49d9-87bc-d29911e573c5 to /dev/vdb
Aug 17 10:26:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1179d28e-1002-49b7-959d-f47e010b275d None None] [instance: d2dbefd6-afaf-4446-977f-69c0ead85a01] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG os_brick.utils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[825fbdef-7222-4c37-aec3-2c8ebf105fe4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d9bced-9b5d-4bac-8ba5-cc60a04f6f33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f007b4-a36f-419d-9173-c65ccca04aa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb3c2ba-e1b3-4ec5-a762-a594e45da73c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:26:42 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0fd843-86ff-4d93-8c47-07521f8e0132]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG os_brick.utils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updating existing volume attachment record: 3162072b-549d-4d95-88e9-b047b8077f88 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:42 user nova-compute[73158]: INFO nova.compute.manager [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Terminating instance
Aug 17 10:26:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-22352b65-5520-45c5-ba94-d8c045bc4807 req-7ea75f64-6b41-4e05-a801-a05b7fe0d332 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-22352b65-5520-45c5-ba94-d8c045bc4807 req-7ea75f64-6b41-4e05-a801-a05b7fe0d332 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-22352b65-5520-45c5-ba94-d8c045bc4807 req-7ea75f64-6b41-4e05-a801-a05b7fe0d332 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-22352b65-5520-45c5-ba94-d8c045bc4807 req-7ea75f64-6b41-4e05-a801-a05b7fe0d332 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-22352b65-5520-45c5-ba94-d8c045bc4807 req-7ea75f64-6b41-4e05-a801-a05b7fe0d332 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-22352b65-5520-45c5-ba94-d8c045bc4807 req-7ea75f64-6b41-4e05-a801-a05b7fe0d332 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-unplugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692267988.2374516, 4fe9c190-01f0-4d1c-af66-cd61aa8334ee => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:43 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] VM Stopped (Lifecycle Event)
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-039c9e31-1663-4cfe-8941-6c5777b3f88a None None] [instance: 4fe9c190-01f0-4d1c-af66-cd61aa8334ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Instance destroyed successfully.
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'resources' on Instance uuid 447f35f1-f3c6-4f5e-96e7-19399846c8f0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-239143835',display_name='tempest-ServerRescueNegativeTestJSON-server-239143835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-239143835',id=25,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1eqcpoo3mn87FQrbz6WGDZPG9poda+eeQbUzmujx/GV+udSmpeDN+Ne6TfsLNXxAQ6hoHiCD+6DyVUw1HBdG0gsxD5Sv+mzbtxuAlIG1Fq0lnNWir8YrHr0eXfFVX5Yw==',key_name='tempest-keypair-1755267754',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-jpvb3hcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc72634020f043308464eca253691603',uuid=447f35f1-f3c6-4f5e-96e7-19399846c8f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "address": "fa:16:3e:01:84:45", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6a648c-93", "ovs_interfaceid": "7e6a648c-93b5-4e7e-956d-ee5de80ca939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG os_vif [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e6a648c-93, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:43 user nova-compute[73158]: INFO os_vif [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:84:45,bridge_name='br-int',has_traffic_filtering=True,id=7e6a648c-93b5-4e7e-956d-ee5de80ca939,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6a648c-93')
Aug 17 10:26:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Deleting instance files /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0_del
Aug 17 10:26:43 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Deletion of /opt/stack/data/nova/instances/447f35f1-f3c6-4f5e-96e7-19399846c8f0_del complete
Aug 17 10:26:43 user nova-compute[73158]: INFO nova.compute.manager [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 17 10:26:43 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:26:43 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:26:44 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:26:44 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Took 0.82 seconds to deallocate network for instance.
Aug 17 10:26:44 user nova-compute[73158]: DEBUG nova.compute.manager [req-fedd8948-2cdf-46e0-b6c2-e482013e1ea4 req-92738b84-c274-4326-ad44-cdc95e6a7feb service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-deleted-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:44 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:26:44 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:26:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-648ded13-1922-4348-ac32-453b22ed7d57 req-3f10ceba-7039-4eff-9de1-eb2613358610 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:26:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-648ded13-1922-4348-ac32-453b22ed7d57 req-3f10ceba-7039-4eff-9de1-eb2613358610 service nova] Acquiring lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:26:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-648ded13-1922-4348-ac32-453b22ed7d57 req-3f10ceba-7039-4eff-9de1-eb2613358610 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:26:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-648ded13-1922-4348-ac32-453b22ed7d57 req-3f10ceba-7039-4eff-9de1-eb2613358610 service nova] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-648ded13-1922-4348-ac32-453b22ed7d57 req-3f10ceba-7039-4eff-9de1-eb2613358610 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] No waiting events found dispatching network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:26:45 user nova-compute[73158]: WARNING nova.compute.manager [req-648ded13-1922-4348-ac32-453b22ed7d57 req-3f10ceba-7039-4eff-9de1-eb2613358610 service nova] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Received unexpected event network-vif-plugged-7e6a648c-93b5-4e7e-956d-ee5de80ca939 for instance with vm_state deleted and task_state None.
Aug 17 10:26:45 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Deleted allocations for instance 447f35f1-f3c6-4f5e-96e7-19399846c8f0
Aug 17 10:26:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2121acec-68a2-4734-9d19-13d85aea7f38 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "447f35f1-f3c6-4f5e-96e7-19399846c8f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:26:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:46 user nova-compute[73158]: INFO nova.compute.manager [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] instance snapshotting
Aug 17 10:26:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Beginning live snapshot process
Aug 17 10:26:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json -f qcow2 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpone3psf9/a09b7afad221462787c1e6d3ebe98f2a.delta 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpone3psf9/a09b7afad221462787c1e6d3ebe98f2a.delta 1073741824" returned: 0 in 0.050s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 10:26:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:26:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73158) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 10:26:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 10:26:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:48 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:26:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpone3psf9/a09b7afad221462787c1e6d3ebe98f2a.delta /opt/stack/data/nova/instances/snapshots/tmpone3psf9/a09b7afad221462787c1e6d3ebe98f2a {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:26:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpone3psf9/a09b7afad221462787c1e6d3ebe98f2a.delta /opt/stack/data/nova/instances/snapshots/tmpone3psf9/a09b7afad221462787c1e6d3ebe98f2a" returned: 0 in 0.658s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:26:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Snapshot extracted, beginning image upload
Aug 17 10:26:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Snapshot image upload complete
Aug 17 10:26:52 user nova-compute[73158]: INFO nova.compute.manager [None req-5d98d486-60de-4704-a3bf-c840aa5b260b tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Took 5.44 seconds to snapshot the instance on the hypervisor.
Aug 17 10:26:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:26:58 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268003.595447, 447f35f1-f3c6-4f5e-96e7-19399846c8f0 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:26:58 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] VM Stopped (Lifecycle Event)
Aug 17 10:26:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-6c9317e3-2c2f-451d-b56b-4a3acb59bbd5 None None] [instance: 447f35f1-f3c6-4f5e-96e7-19399846c8f0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:26:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWFQEpna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:27:00 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:27:00 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:27:00 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fd4485-9d77-4547-bc97-2fbb3afa30a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:27:00 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc2d21-ecbd-4531-a761-19729eeffc41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5] added
Aug 17 10:27:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551b2cd-ec5d-45a6-b7b3-d4905a60faee]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4041be3-bb8d-4774-9d40-4ce8dfdc6525]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWFQEpna {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWFQEpna" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c9a19-af5a-4239-9632-04b1fc5f1c5f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWFQEpna'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d0fa3b-63b4-437f-8454-b5ee7da243e4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17129e-eaf0-462c-a37b-be34a1db6803]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[91129c08-8315-4b59-97a0-8aecee9e8d76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260]
Aug 17 10:27:00 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260] successful.
Aug 17 10:27:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe29b15-22d5-40c4-9f42-3459340f41f2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b186ab36-3cf2-4b1f-adbf-91a96561b5c5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 (non-flash)
Aug 17 10:27:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[161e7182-b103-4ac0-b9f2-f0c6c4cc0f52]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:27:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWFQEpna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23165386534626334', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165386534626334', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:27:01 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:27:01 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:27:01 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:27:01 user nova-compute[73158]:   <serial>29d13745-af82-49d9-87bc-d29911e573c5</serial>
Aug 17 10:27:01 user nova-compute[73158]: </disk>
Aug 17 10:27:01 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:27:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:20:f6:7b, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:27:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4e701ebf-c22d-4dea-911a-38aaf72351d2 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.934s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:02 user nova-compute[73158]: INFO nova.compute.manager [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Detaching volume 29d13745-af82-49d9-87bc-d29911e573c5
Aug 17 10:27:02 user nova-compute[73158]: INFO nova.virt.block_device [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Attempting to driver detach volume 29d13745-af82-49d9-87bc-d29911e573c5 from mountpoint /dev/vdb
Aug 17 10:27:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Attempting to detach device vdb from instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:27:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:27:02 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:27:02 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:27:02 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:27:02 user nova-compute[73158]:   <serial>29d13745-af82-49d9-87bc-d29911e573c5</serial>
Aug 17 10:27:02 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:27:02 user nova-compute[73158]: </disk>
Aug 17 10:27:02 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:27:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully detached device vdb from instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e from the persistent domain config.
Aug 17 10:27:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:27:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:27:02 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:27:02 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:27:02 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:27:02 user nova-compute[73158]:   <serial>29d13745-af82-49d9-87bc-d29911e573c5</serial>
Aug 17 10:27:02 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:27:02 user nova-compute[73158]: </disk>
Aug 17 10:27:02 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268023.2006125, 65ca631c-9503-43e3-8b01-c350d9c1eb3e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:27:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully detached device vdb from instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e from the live domain config.
Aug 17 10:27:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWFQEpna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:27:03 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[203db5a8-f940-49b1-b263-9d9ab1012409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a1aa0-5a32-46ae-aed9-44b8a85a38a4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:27:03 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:27:03 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:27:03 user nova-compute[73158]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 (non-flash)
Aug 17 10:27:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:27:03 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:27:03 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:27:03 user nova-compute[73158]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 (non-flash)
Aug 17 10:27:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3f3d3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[37863a35-b9e4-4b23-97c8-6690a13b4309]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9acd7c6-692f-477a-92b7-538844671b22]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae318814-40e5-4086-817a-37233e12f836]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fca3486-020a-4627-9124-a0ef96166b08]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862c6b0-1460-4ee9-b6f4-205c61da351c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de79a2-f152-4ead-8de9-b6eab1e526ab]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260]
Aug 17 10:27:03 user nova-compute[73158]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5, portal: 172.16.0.220,3260] successful.
Aug 17 10:27:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d13745-af82-49d9-87bc-d29911e573c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eebb1e-e552-4235-bc70-c3dc3365bcf0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== disconnect_volume: return (285ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:27:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4fe3c40-fb94-4cc7-a74a-e5a123fb873c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Going to confirm migration 2 {{(pid=73158) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquired lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:27:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'info_cache' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [{"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Releasing lock "refresh_cache-008cc48e-5db1-4f5d-b133-e9577cabe4f8" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'migration_context' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:27:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.407s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:06 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Deleted allocation for migration e9085077-8046-4c75-a716-5ce982c8e3c6
Aug 17 10:27:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c27be3b1-9087-4750-b2d4-60b888a9c133 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.772s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquired lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'info_cache' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Releasing lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance destroyed successfully.
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'resources' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:25:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG os_vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4639473-b3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:13 user nova-compute[73158]: INFO os_vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3')
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start _get_guest_xml network_info=[{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'numa_topology' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:27:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:25:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'pci_devices' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:27:13 user nova-compute[73158]:   <uuid>a6744f73-a7ec-4388-8e15-c05068041a09</uuid>
Aug 17 10:27:13 user nova-compute[73158]:   <name>instance-00000017</name>
Aug 17 10:27:13 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:27:13 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:27:13 user nova-compute[73158]:   <metadata>
Aug 17 10:27:13 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:27:13 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:27:13 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeTestJSON-server-1347333996</nova:name>
Aug 17 10:27:13 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:27:13</nova:creationTime>
Aug 17 10:27:13 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:27:13 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:27:13 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:27:13 user nova-compute[73158]:       <nova:owner>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:user uuid="1230fe2ff59346c7a312ef772820cab1">tempest-AttachVolumeTestJSON-1679631742-project-member</nova:user>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:project uuid="d6ec620087724665b6218bb575bfcbef">tempest-AttachVolumeTestJSON-1679631742</nova:project>
Aug 17 10:27:13 user nova-compute[73158]:       </nova:owner>
Aug 17 10:27:13 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:27:13 user nova-compute[73158]:       <nova:ports>
Aug 17 10:27:13 user nova-compute[73158]:         <nova:port uuid="e4639473-b396-4d8c-aadc-30d8e10252cb">
Aug 17 10:27:13 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:27:13 user nova-compute[73158]:         </nova:port>
Aug 17 10:27:13 user nova-compute[73158]:       </nova:ports>
Aug 17 10:27:13 user nova-compute[73158]:     </nova:instance>
Aug 17 10:27:13 user nova-compute[73158]:   </metadata>
Aug 17 10:27:13 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:27:13 user nova-compute[73158]:     <system>
Aug 17 10:27:13 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:27:13 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:27:13 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:27:13 user nova-compute[73158]:       <entry name="serial">a6744f73-a7ec-4388-8e15-c05068041a09</entry>
Aug 17 10:27:13 user nova-compute[73158]:       <entry name="uuid">a6744f73-a7ec-4388-8e15-c05068041a09</entry>
Aug 17 10:27:13 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:27:13 user nova-compute[73158]:     </system>
Aug 17 10:27:13 user nova-compute[73158]:   </sysinfo>
Aug 17 10:27:13 user nova-compute[73158]:   <os>
Aug 17 10:27:13 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:27:13 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:27:13 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:27:13 user nova-compute[73158]:   </os>
Aug 17 10:27:13 user nova-compute[73158]:   <features>
Aug 17 10:27:13 user nova-compute[73158]:     <acpi/>
Aug 17 10:27:13 user nova-compute[73158]:     <apic/>
Aug 17 10:27:13 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:27:13 user nova-compute[73158]:   </features>
Aug 17 10:27:13 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:27:13 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:27:13 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:27:13 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:27:13 user nova-compute[73158]:   </clock>
Aug 17 10:27:13 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:27:13 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:27:13 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:27:13 user nova-compute[73158]:   </cpu>
Aug 17 10:27:13 user nova-compute[73158]:   <devices>
Aug 17 10:27:13 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:27:13 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:27:13 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk"/>
Aug 17 10:27:13 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:27:13 user nova-compute[73158]:     </disk>
Aug 17 10:27:13 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:27:13 user nova-compute[73158]:       <mac address="fa:16:3e:c1:86:11"/>
Aug 17 10:27:13 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:27:13 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:27:13 user nova-compute[73158]:       <target dev="tape4639473-b3"/>
Aug 17 10:27:13 user nova-compute[73158]:     </interface>
Aug 17 10:27:13 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:27:13 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/console.log" append="off"/>
Aug 17 10:27:13 user nova-compute[73158]:     </serial>
Aug 17 10:27:13 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:27:13 user nova-compute[73158]:     <video>
Aug 17 10:27:13 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:27:13 user nova-compute[73158]:     </video>
Aug 17 10:27:13 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:27:13 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:27:13 user nova-compute[73158]:     </rng>
Aug 17 10:27:13 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:27:13 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:27:13 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:27:13 user nova-compute[73158]:     </memballoon>
Aug 17 10:27:13 user nova-compute[73158]:   </devices>
Aug 17 10:27:13 user nova-compute[73158]: </domain>
Aug 17 10:27:13 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:27:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Cannot resize image /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'migration_context' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:25:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG os_vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4639473-b3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4639473-b3, col_values=(('external_ids', {'iface-id': 'e4639473-b396-4d8c-aadc-30d8e10252cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:86:11', 'vm-uuid': 'a6744f73-a7ec-4388-8e15-c05068041a09'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:27:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:14 user nova-compute[73158]: INFO os_vif [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3')
Aug 17 10:27:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-493c4c26-d8bc-427d-b6d1-d0eb0ee00393 req-d9aa2d10-e174-45a4-afc7-68735c4eeec9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-493c4c26-d8bc-427d-b6d1-d0eb0ee00393 req-d9aa2d10-e174-45a4-afc7-68735c4eeec9 service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-493c4c26-d8bc-427d-b6d1-d0eb0ee00393 req-d9aa2d10-e174-45a4-afc7-68735c4eeec9 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-493c4c26-d8bc-427d-b6d1-d0eb0ee00393 req-d9aa2d10-e174-45a4-afc7-68735c4eeec9 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-493c4c26-d8bc-427d-b6d1-d0eb0ee00393 req-d9aa2d10-e174-45a4-afc7-68735c4eeec9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:16 user nova-compute[73158]: WARNING nova.compute.manager [req-493c4c26-d8bc-427d-b6d1-d0eb0ee00393 req-d9aa2d10-e174-45a4-afc7-68735c4eeec9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state stopped and task_state powering-on.
Aug 17 10:27:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268038.2030447, a6744f73-a7ec-4388-8e15-c05068041a09 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:27:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Resumed (Lifecycle Event)
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:27:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance rebooted successfully.
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-409f9ef4-d250-477c-974f-ad59f43cf875 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:27:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268038.2052805, a6744f73-a7ec-4388-8e15-c05068041a09 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:27:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Started (Lifecycle Event)
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-a9d5348b-f255-4747-9122-75ec0956a3cc req-a30826c5-de22-488f-bb22-5a5cefe6a987 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a9d5348b-f255-4747-9122-75ec0956a3cc req-a30826c5-de22-488f-bb22-5a5cefe6a987 service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a9d5348b-f255-4747-9122-75ec0956a3cc req-a30826c5-de22-488f-bb22-5a5cefe6a987 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a9d5348b-f255-4747-9122-75ec0956a3cc req-a30826c5-de22-488f-bb22-5a5cefe6a987 service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-a9d5348b-f255-4747-9122-75ec0956a3cc req-a30826c5-de22-488f-bb22-5a5cefe6a987 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:18 user nova-compute[73158]: WARNING nova.compute.manager [req-a9d5348b-f255-4747-9122-75ec0956a3cc req-a30826c5-de22-488f-bb22-5a5cefe6a987 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state active and task_state None.
Aug 17 10:27:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:27:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:27:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:27:35 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7191MB free_disk=24.087860107421875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6450f74c-709c-47b9-9d6a-74aa81de118f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 10c7414f-40f2-46f4-aa1e-e8d8516d0329 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:27:35 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.007s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:27:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:27:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:27:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [{"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-a6744f73-a7ec-4388-8e15-c05068041a09" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:27:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:27:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:27:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:48 user nova-compute[73158]: INFO nova.compute.manager [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Terminating instance
Aug 17 10:27:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-10589c79-57e7-44ad-8d0f-be30e5a559fa req-bb85c2bf-74c2-409e-b49d-2874cb60e7ac service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-unplugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-10589c79-57e7-44ad-8d0f-be30e5a559fa req-bb85c2bf-74c2-409e-b49d-2874cb60e7ac service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-10589c79-57e7-44ad-8d0f-be30e5a559fa req-bb85c2bf-74c2-409e-b49d-2874cb60e7ac service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-10589c79-57e7-44ad-8d0f-be30e5a559fa req-bb85c2bf-74c2-409e-b49d-2874cb60e7ac service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-10589c79-57e7-44ad-8d0f-be30e5a559fa req-bb85c2bf-74c2-409e-b49d-2874cb60e7ac service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-unplugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-10589c79-57e7-44ad-8d0f-be30e5a559fa req-bb85c2bf-74c2-409e-b49d-2874cb60e7ac service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-unplugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Instance destroyed successfully.
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'resources' on Instance uuid 6450f74c-709c-47b9-9d6a-74aa81de118f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-776375975',display_name='tempest-ServerRescueNegativeTestJSON-server-776375975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-776375975',id=2,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-y6lb094v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:13:23Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=6450f74c-709c-47b9-9d6a-74aa81de118f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "address": "fa:16:3e:bd:d8:62", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507dedf7-87", "ovs_interfaceid": "507dedf7-8751-47a4-be6a-8e1cab4bd4da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG os_vif [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap507dedf7-87, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:49 user nova-compute[73158]: INFO os_vif [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:62,bridge_name='br-int',has_traffic_filtering=True,id=507dedf7-8751-47a4-be6a-8e1cab4bd4da,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507dedf7-87')
Aug 17 10:27:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Deleting instance files /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f_del
Aug 17 10:27:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Deletion of /opt/stack/data/nova/instances/6450f74c-709c-47b9-9d6a-74aa81de118f_del complete
Aug 17 10:27:49 user nova-compute[73158]: INFO nova.compute.manager [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 10:27:49 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:27:49 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Took 0.49 seconds to deallocate network for instance.
Aug 17 10:27:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-4e6c96a9-7628-4897-bc36-59b904eda238 req-b3a13511-9738-47f3-9794-4eba8c6ea5c0 service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-deleted-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:50 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Deleted allocations for instance 6450f74c-709c-47b9-9d6a-74aa81de118f
Aug 17 10:27:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5e46883a-b25f-4d4e-896f-703edd02fe54 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-577044e4-7dc0-40db-8110-a04c5ffa4ccf req-f7ebd8b2-3d39-49ef-918e-16f491800e3d service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-577044e4-7dc0-40db-8110-a04c5ffa4ccf req-f7ebd8b2-3d39-49ef-918e-16f491800e3d service nova] Acquiring lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-577044e4-7dc0-40db-8110-a04c5ffa4ccf req-f7ebd8b2-3d39-49ef-918e-16f491800e3d service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-577044e4-7dc0-40db-8110-a04c5ffa4ccf req-f7ebd8b2-3d39-49ef-918e-16f491800e3d service nova] Lock "6450f74c-709c-47b9-9d6a-74aa81de118f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-577044e4-7dc0-40db-8110-a04c5ffa4ccf req-f7ebd8b2-3d39-49ef-918e-16f491800e3d service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] No waiting events found dispatching network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:50 user nova-compute[73158]: WARNING nova.compute.manager [req-577044e4-7dc0-40db-8110-a04c5ffa4ccf req-f7ebd8b2-3d39-49ef-918e-16f491800e3d service nova] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Received unexpected event network-vif-plugged-507dedf7-8751-47a4-be6a-8e1cab4bd4da for instance with vm_state deleted and task_state None.
Aug 17 10:27:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:53 user nova-compute[73158]: INFO nova.compute.manager [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Terminating instance
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-fb0794db-ab6a-44f2-9793-4166d2b18079 req-a90aa565-aeba-4a69-bd39-0c31b7610d41 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-unplugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fb0794db-ab6a-44f2-9793-4166d2b18079 req-a90aa565-aeba-4a69-bd39-0c31b7610d41 service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fb0794db-ab6a-44f2-9793-4166d2b18079 req-a90aa565-aeba-4a69-bd39-0c31b7610d41 service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fb0794db-ab6a-44f2-9793-4166d2b18079 req-a90aa565-aeba-4a69-bd39-0c31b7610d41 service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-fb0794db-ab6a-44f2-9793-4166d2b18079 req-a90aa565-aeba-4a69-bd39-0c31b7610d41 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-unplugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-fb0794db-ab6a-44f2-9793-4166d2b18079 req-a90aa565-aeba-4a69-bd39-0c31b7610d41 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-unplugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Instance destroyed successfully.
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'resources' on Instance uuid 65ca631c-9503-43e3-8b01-c350d9c1eb3e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1100366227',display_name='tempest-AttachVolumeNegativeTest-server-1100366227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1100366227',id=30,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfwdcNskz4pSWWPRPMgO+3nxRElfJqV2t8+gAbpjPY719bazjoCxjBmKr0irOpB6SniSZ4jxg5fEczN7GmUBLstXiuB+YmHQRnRa3xvnpOUFsyC6d9ZXep/i0++35vFgg==',key_name='tempest-keypair-1761684782',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-3lqd5ur7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=65ca631c-9503-43e3-8b01-c350d9c1eb3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "address": "fa:16:3e:20:f6:7b", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee15fce-fa", "ovs_interfaceid": "6ee15fce-fad3-4b26-8da7-a496a7da96c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG os_vif [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ee15fce-fa, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: INFO os_vif [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:f6:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ee15fce-fad3-4b26-8da7-a496a7da96c2,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee15fce-fa')
Aug 17 10:27:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Deleting instance files /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e_del
Aug 17 10:27:53 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Deletion of /opt/stack/data/nova/instances/65ca631c-9503-43e3-8b01-c350d9c1eb3e_del complete
Aug 17 10:27:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:53 user nova-compute[73158]: INFO nova.compute.manager [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 10:27:53 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:27:53 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:27:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:27:55 user nova-compute[73158]: INFO nova.compute.claims [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Claim successful on node user
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:55 user nova-compute[73158]: WARNING nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received unexpected event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with vm_state active and task_state deleting.
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:55 user nova-compute[73158]: WARNING nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received unexpected event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with vm_state active and task_state deleting.
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:55 user nova-compute[73158]: WARNING nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received unexpected event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with vm_state active and task_state deleting.
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-unplugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-unplugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc9d2de5-74a3-4d72-a98d-7d60999c5273 req-ff9e8d2f-2a6c-42ee-a34a-3d453c52289e service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-unplugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:27:55 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Took 1.94 seconds to deallocate network for instance.
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:27:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.077s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:27:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:27:56 user nova-compute[73158]: INFO nova.virt.block_device [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Booting with volume-backed-image 9b73e703-52fe-4fe4-ae2e-19e6c25bad78 at /dev/vda
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.policy [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bfd8d8513d24d0d893689d5db089546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbba4c18d534970a667590744f891a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:56 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Deleted allocations for instance 65ca631c-9503-43e3-8b01-c350d9c1eb3e
Aug 17 10:27:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5b7df61-9f6b-42c6-8f45-3ceec188385c tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.471s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Successfully created port: c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:27:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] Acquiring lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] Lock "65ca631c-9503-43e3-8b01-c350d9c1eb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:27:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] No waiting events found dispatching network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:27:57 user nova-compute[73158]: WARNING nova.compute.manager [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received unexpected event network-vif-plugged-6ee15fce-fad3-4b26-8da7-a496a7da96c2 for instance with vm_state deleted and task_state None.
Aug 17 10:27:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-07b5526d-c062-40fc-a5a4-a36126d8f875 req-a3fff327-762c-41b0-9b12-460a05568383 service nova] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Received event network-vif-deleted-6ee15fce-fad3-4b26-8da7-a496a7da96c2 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Successfully updated port: c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updating instance_info_cache with network_info: [{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:27:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance network_info: |[{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-changed-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Refreshing instance network info cache due to event network-changed-c2d13c32-7396-494d-8548-94f9beea394a. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] Acquiring lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] Acquired lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Refreshing network info cache for port c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing instance network info cache due to event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG nova.network.neutron [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:27:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:27:59 user nova-compute[73158]: INFO nova.compute.manager [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Detaching volume 7e0fd4a4-23c9-481c-8ffc-1717a3940a78
Aug 17 10:27:59 user nova-compute[73158]: INFO nova.virt.block_device [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Attempting to driver detach volume 7e0fd4a4-23c9-481c-8ffc-1717a3940a78 from mountpoint /dev/vdb
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Attempting to detach device vdb from instance 18c69e67-2459-4e44-b6cb-0321b02259a3 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:28:00 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:28:00 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:28:00 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:28:00 user nova-compute[73158]:   <serial>7e0fd4a4-23c9-481c-8ffc-1717a3940a78</serial>
Aug 17 10:28:00 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:28:00 user nova-compute[73158]: </disk>
Aug 17 10:28:00 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:28:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully detached device vdb from instance 18c69e67-2459-4e44-b6cb-0321b02259a3 from the persistent domain config.
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18c69e67-2459-4e44-b6cb-0321b02259a3 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:28:00 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:28:00 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:28:00 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:28:00 user nova-compute[73158]:   <serial>7e0fd4a4-23c9-481c-8ffc-1717a3940a78</serial>
Aug 17 10:28:00 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:28:00 user nova-compute[73158]: </disk>
Aug 17 10:28:00 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268080.4810488, 18c69e67-2459-4e44-b6cb-0321b02259a3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:28:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully detached device vdb from instance 18c69e67-2459-4e44-b6cb-0321b02259a3 from the live domain config.
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDxXwfYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:28:00 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb009e61-0b76-4dbb-813f-c78845d18c88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad0905-3cf9-4440-aafa-01d847faf202]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:28:00 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:28:00 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:28:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:28:00 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:28:00 user nova-compute[73158]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 (non-flash)
Aug 17 10:28:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc34276a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78'): ({'sde'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Removing single pathed devices sde {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f12cb-5722-47a0-88be-d9431e5daf2a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db09a12-a827-4390-b672-4f106eeab52b]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flushing IO for device /dev/sde {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ae272-c98c-4818-bafe-d4b966d22c88]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb29d373-126e-49e9-8f4a-2cdc933b88e2]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updated VIF entry in instance network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3837a8-3898-47f2-8baf-33a70c61cc02]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updated VIF entry in instance network info cache for port c2d13c32-7396-494d-8548-94f9beea394a. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updating instance_info_cache with network_info: [{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] Releasing lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing instance network info cache due to event network-changed-00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] Acquiring lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-17481a6f-8e93-4aad-97b8-f39ad89740bc req-adc63b41-911e-4feb-be20-5398079a6821 service nova] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] Acquired lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Refreshing network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[00abeadb-9857-42e6-aac2-b956b565c812]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260]
Aug 17 10:28:00 user nova-compute[73158]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78, portal: 172.16.0.220,3260] successful.
Aug 17 10:28:00 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0fd4a4-23c9-481c-8ffc-1717a3940a78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4732443f-a6ce-4815-adfc-0906c6f9a7b7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== disconnect_volume: return (322ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:28:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:28:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updated VIF entry in instance network info cache for port 00e0222d-048b-4880-a9e1-0c4dec6749e8. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:28:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [{"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b814becf-ad02-4041-881e-5d7f2da6f214 req-b09ebf7e-e4d6-4730-a731-9b6416f8e2a2 service nova] Releasing lock "refresh_cache-18c69e67-2459-4e44-b6cb-0321b02259a3" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:28:01 user nova-compute[73158]: DEBUG nova.objects.instance [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'flavor' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:28:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f65c11cb-9335-449a-b859-54d6ffdd6cb8 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.805s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:04 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268069.0401084, 6450f74c-709c-47b9-9d6a-74aa81de118f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:04 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] VM Stopped (Lifecycle Event)
Aug 17 10:28:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-15d74c20-8fd0-4d91-9670-57bbde134ed9 None None] [instance: 6450f74c-709c-47b9-9d6a-74aa81de118f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG os_brick.utils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a0aeb9-b31c-459b-9917-6cfad6a59a99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf111e1-43a6-4c29-aa29-c2c875ddc749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57b7272-5b76-4cd0-a7c7-ae80868e7dc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f36a0da-af2d-48ca-a611-801f9fcbbd33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:28:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:28:07 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:28:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59f7b15-51e4-4cea-9a3d-d03715857bb4]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:28:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:28:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:28:07 user nova-compute[73158]: DEBUG os_brick.utils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:28:07 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updating existing volume attachment record: 39495bc2-fabd-4212-af0d-16ab9b3e5c16 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:28:08 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268073.7841523, 65ca631c-9503-43e3-8b01-c350d9c1eb3e => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:08 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] VM Stopped (Lifecycle Event)
Aug 17 10:28:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-60630e29-9aff-46da-bfeb-54ee93b1dd86 None None] [instance: 65ca631c-9503-43e3-8b01-c350d9c1eb3e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:28:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:28:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:28:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:28:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Creating image(s)
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Ensure instance console log exists: /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Start _get_guest_xml network_info=[{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '39495bc2-fabd-4212-af0d-16ab9b3e5c16', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '204904fe-4ce2-4aff-bd50-c4f79fab6899', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4930fdb-0f26-43a2-8ba5-e70d91420838', 'serial': 'c4930fdb-0f26-43a2-8ba5-e70d91420838'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:28:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:28:18 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:28:18 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:28:18 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:28:18 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c1a5e-248e-4f62-8172-5ec0043f2871]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:28:18 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a5781-1b3a-4e65-b2b7-0e363e2f8a82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838] added
Aug 17 10:28:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[719bfa4c-843f-4519-a23d-285a1efbf1a1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[269e1a83-e89e-4de0-ba95-4b9143baec8d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtSrbwlN {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtSrbwlN" returned: 0 in 0.036s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422b599-f452-42d3-971a-8ed8500f0d7a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtSrbwlN'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccde37c-19a1-46c0-a2a6-a85dc78590e2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea7ad10-7e09-44ec-9e2c-07be3cfc677a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:28:18 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:28:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:28:18 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:28:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69adaad-72b0-4161-89eb-16c16312913c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260]
Aug 17 10:28:18 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260] successful.
Aug 17 10:28:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51fe0e-1073-4bff-af03-5973f7b81962]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa1a99-9b93-430c-bd98-762f031f15d6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:28:18 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:28:18 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:28:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:28:18 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:28:18 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:28:18 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374dd06-5e48-4196-9e81-9d62bbe41b9b]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:28:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26564333465656135', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564333465656135', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:27:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127959669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127959669',id=33,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-mda99a1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:27:56Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=204904fe-4ce2-4aff-bd50-c4f79fab6899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'pci_devices' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:28:19 user nova-compute[73158]:   <uuid>204904fe-4ce2-4aff-bd50-c4f79fab6899</uuid>
Aug 17 10:28:19 user nova-compute[73158]:   <name>instance-00000021</name>
Aug 17 10:28:19 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:28:19 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:28:19 user nova-compute[73158]:   <metadata>
Aug 17 10:28:19 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:28:19 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:28:19 user nova-compute[73158]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-127959669</nova:name>
Aug 17 10:28:19 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:28:18</nova:creationTime>
Aug 17 10:28:19 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:28:19 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:28:19 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:28:19 user nova-compute[73158]:       <nova:owner>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:user uuid="9bfd8d8513d24d0d893689d5db089546">tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member</nova:user>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:project uuid="9bbba4c18d534970a667590744f891a2">tempest-ServerBootFromVolumeStableRescueTest-184800752</nova:project>
Aug 17 10:28:19 user nova-compute[73158]:       </nova:owner>
Aug 17 10:28:19 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:28:19 user nova-compute[73158]:       <nova:ports>
Aug 17 10:28:19 user nova-compute[73158]:         <nova:port uuid="c2d13c32-7396-494d-8548-94f9beea394a">
Aug 17 10:28:19 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:28:19 user nova-compute[73158]:         </nova:port>
Aug 17 10:28:19 user nova-compute[73158]:       </nova:ports>
Aug 17 10:28:19 user nova-compute[73158]:     </nova:instance>
Aug 17 10:28:19 user nova-compute[73158]:   </metadata>
Aug 17 10:28:19 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:28:19 user nova-compute[73158]:     <system>
Aug 17 10:28:19 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:28:19 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:28:19 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:28:19 user nova-compute[73158]:       <entry name="serial">204904fe-4ce2-4aff-bd50-c4f79fab6899</entry>
Aug 17 10:28:19 user nova-compute[73158]:       <entry name="uuid">204904fe-4ce2-4aff-bd50-c4f79fab6899</entry>
Aug 17 10:28:19 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:28:19 user nova-compute[73158]:     </system>
Aug 17 10:28:19 user nova-compute[73158]:   </sysinfo>
Aug 17 10:28:19 user nova-compute[73158]:   <os>
Aug 17 10:28:19 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:28:19 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:28:19 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:28:19 user nova-compute[73158]:   </os>
Aug 17 10:28:19 user nova-compute[73158]:   <features>
Aug 17 10:28:19 user nova-compute[73158]:     <acpi/>
Aug 17 10:28:19 user nova-compute[73158]:     <apic/>
Aug 17 10:28:19 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:28:19 user nova-compute[73158]:   </features>
Aug 17 10:28:19 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:28:19 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:28:19 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:28:19 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:28:19 user nova-compute[73158]:   </clock>
Aug 17 10:28:19 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:28:19 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:28:19 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:28:19 user nova-compute[73158]:   </cpu>
Aug 17 10:28:19 user nova-compute[73158]:   <devices>
Aug 17 10:28:19 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:28:19 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:28:19 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:28:19 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:28:19 user nova-compute[73158]:       <serial>c4930fdb-0f26-43a2-8ba5-e70d91420838</serial>
Aug 17 10:28:19 user nova-compute[73158]:     </disk>
Aug 17 10:28:19 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:28:19 user nova-compute[73158]:       <mac address="fa:16:3e:0e:c7:27"/>
Aug 17 10:28:19 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:28:19 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:28:19 user nova-compute[73158]:       <target dev="tapc2d13c32-73"/>
Aug 17 10:28:19 user nova-compute[73158]:     </interface>
Aug 17 10:28:19 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:28:19 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/console.log" append="off"/>
Aug 17 10:28:19 user nova-compute[73158]:     </serial>
Aug 17 10:28:19 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:28:19 user nova-compute[73158]:     <video>
Aug 17 10:28:19 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:28:19 user nova-compute[73158]:     </video>
Aug 17 10:28:19 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:28:19 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:28:19 user nova-compute[73158]:     </rng>
Aug 17 10:28:19 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:28:19 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:28:19 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:28:19 user nova-compute[73158]:     </memballoon>
Aug 17 10:28:19 user nova-compute[73158]:   </devices>
Aug 17 10:28:19 user nova-compute[73158]: </domain>
Aug 17 10:28:19 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:27:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127959669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127959669',id=33,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-mda99a1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:27:56Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=204904fe-4ce2-4aff-bd50-c4f79fab6899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG os_vif [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2d13c32-73, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2d13c32-73, col_values=(('external_ids', {'iface-id': 'c2d13c32-7396-494d-8548-94f9beea394a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:c7:27', 'vm-uuid': '204904fe-4ce2-4aff-bd50-c4f79fab6899'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:19 user nova-compute[73158]: INFO os_vif [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73')
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:28:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No VIF found with MAC fa:16:3e:0e:c7:27, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-2195339d-2acd-46da-9d83-a2f486dd7067 req-38671817-54e1-4d47-870d-b630f386cab9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2195339d-2acd-46da-9d83-a2f486dd7067 req-38671817-54e1-4d47-870d-b630f386cab9 service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2195339d-2acd-46da-9d83-a2f486dd7067 req-38671817-54e1-4d47-870d-b630f386cab9 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2195339d-2acd-46da-9d83-a2f486dd7067 req-38671817-54e1-4d47-870d-b630f386cab9 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-2195339d-2acd-46da-9d83-a2f486dd7067 req-38671817-54e1-4d47-870d-b630f386cab9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:21 user nova-compute[73158]: WARNING nova.compute.manager [req-2195339d-2acd-46da-9d83-a2f486dd7067 req-38671817-54e1-4d47-870d-b630f386cab9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state building and task_state spawning.
Aug 17 10:28:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268103.5066407, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Resumed (Lifecycle Event)
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance spawned successfully.
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-b845c3d3-a1f4-4682-97ac-e18c70794af3 req-de5b005c-92c2-4288-ada9-a5dbb14b1a5b service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b845c3d3-a1f4-4682-97ac-e18c70794af3 req-de5b005c-92c2-4288-ada9-a5dbb14b1a5b service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b845c3d3-a1f4-4682-97ac-e18c70794af3 req-de5b005c-92c2-4288-ada9-a5dbb14b1a5b service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b845c3d3-a1f4-4682-97ac-e18c70794af3 req-de5b005c-92c2-4288-ada9-a5dbb14b1a5b service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-b845c3d3-a1f4-4682-97ac-e18c70794af3 req-de5b005c-92c2-4288-ada9-a5dbb14b1a5b service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:23 user nova-compute[73158]: WARNING nova.compute.manager [req-b845c3d3-a1f4-4682-97ac-e18c70794af3 req-de5b005c-92c2-4288-ada9-a5dbb14b1a5b service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state building and task_state spawning.
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268103.507731, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Started (Lifecycle Event)
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 17 10:28:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Took 28.30 seconds to build instance.
Aug 17 10:28:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c3db156-d589-4cd6-90bd-a822b0284540 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.394s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:25 user nova-compute[73158]: INFO nova.compute.manager [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Terminating instance
Aug 17 10:28:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b6da5bee-ca06-4ce5-8b57-cab0b941be7c req-3d5077c4-0225-4828-97a0-0271224a43b1 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-vif-unplugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b6da5bee-ca06-4ce5-8b57-cab0b941be7c req-3d5077c4-0225-4828-97a0-0271224a43b1 service nova] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b6da5bee-ca06-4ce5-8b57-cab0b941be7c req-3d5077c4-0225-4828-97a0-0271224a43b1 service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b6da5bee-ca06-4ce5-8b57-cab0b941be7c req-3d5077c4-0225-4828-97a0-0271224a43b1 service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b6da5bee-ca06-4ce5-8b57-cab0b941be7c req-3d5077c4-0225-4828-97a0-0271224a43b1 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] No waiting events found dispatching network-vif-unplugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-b6da5bee-ca06-4ce5-8b57-cab0b941be7c req-3d5077c4-0225-4828-97a0-0271224a43b1 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-vif-unplugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:28:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Instance destroyed successfully.
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.objects.instance [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lazy-loading 'resources' on Instance uuid 10c7414f-40f2-46f4-aa1e-e8d8516d0329 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1757296826',display_name='tempest-VolumesActionsTest-instance-1757296826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1757296826',id=32,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67d1716206474e9793bc7d5ccc1c46a7',ramdisk_id='',reservation_id='r-ekks4102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-401914087',owner_user_name='tempest-VolumesActionsTest-401914087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:26:29Z,user_data=None,user_id='8ffd30bbc5964c5abf76e663dcd4f38f',uuid=10c7414f-40f2-46f4-aa1e-e8d8516d0329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Converting VIF {"id": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "address": "fa:16:3e:cb:8a:75", "network": {"id": "cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-801852402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d1716206474e9793bc7d5ccc1c46a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbdf6df-27", "ovs_interfaceid": "cfbdf6df-2711-457a-ad8b-ece8d3c1438c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG os_vif [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfbdf6df-27, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:26 user nova-compute[73158]: INFO os_vif [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8a:75,bridge_name='br-int',has_traffic_filtering=True,id=cfbdf6df-2711-457a-ad8b-ece8d3c1438c,network=Network(cee40e07-affb-4ecf-9b7b-46b0c8d4a2b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbdf6df-27')
Aug 17 10:28:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Deleting instance files /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329_del
Aug 17 10:28:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Deletion of /opt/stack/data/nova/instances/10c7414f-40f2-46f4-aa1e-e8d8516d0329_del complete
Aug 17 10:28:26 user nova-compute[73158]: INFO nova.compute.manager [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 17 10:28:26 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:26 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Took 0.64 seconds to deallocate network for instance.
Aug 17 10:28:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:27 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Deleted allocations for instance 10c7414f-40f2-46f4-aa1e-e8d8516d0329
Aug 17 10:28:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f2a5da62-7920-45fc-b5e4-0009219ef602 tempest-VolumesActionsTest-401914087 tempest-VolumesActionsTest-401914087-project-member] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] Acquiring lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] Lock "10c7414f-40f2-46f4-aa1e-e8d8516d0329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] No waiting events found dispatching network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:27 user nova-compute[73158]: WARNING nova.compute.manager [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received unexpected event network-vif-plugged-cfbdf6df-2711-457a-ad8b-ece8d3c1438c for instance with vm_state deleted and task_state None.
Aug 17 10:28:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-0f02e82e-8825-4bdf-aa08-018ee663dc72 req-c99e5364-b45e-4708-996b-7cadd9ed9044 service nova] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Received event network-vif-deleted-cfbdf6df-2711-457a-ad8b-ece8d3c1438c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:28:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:33 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:28:33 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7534MB free_disk=24.158309936523438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance ca69a434-ae39-4400-a07f-b49c41f99e84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a6744f73-a7ec-4388-8e15-c05068041a09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 204904fe-4ce2-4aff-bd50-c4f79fab6899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:28:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:35 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:28:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:28:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:28:35 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid f59460b3-cc6b-49db-b4d7-a86e2006de30 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 300a9c6a-ed23-494d-8f26-9b5b333273f4 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:39 user nova-compute[73158]: INFO nova.compute.manager [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Terminating instance
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-932a073f-89dc-4a15-90e1-789c8f1fc424 req-07a9f061-d8d8-47e0-ac3e-65753320586a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-932a073f-89dc-4a15-90e1-789c8f1fc424 req-07a9f061-d8d8-47e0-ac3e-65753320586a service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-932a073f-89dc-4a15-90e1-789c8f1fc424 req-07a9f061-d8d8-47e0-ac3e-65753320586a service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-932a073f-89dc-4a15-90e1-789c8f1fc424 req-07a9f061-d8d8-47e0-ac3e-65753320586a service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-932a073f-89dc-4a15-90e1-789c8f1fc424 req-07a9f061-d8d8-47e0-ac3e-65753320586a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-932a073f-89dc-4a15-90e1-789c8f1fc424 req-07a9f061-d8d8-47e0-ac3e-65753320586a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-unplugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:28:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Instance destroyed successfully.
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lazy-loading 'resources' on Instance uuid ca69a434-ae39-4400-a07f-b49c41f99e84 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-396406171',display_name='tempest-ServerRescueNegativeTestJSON-server-396406171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-396406171',id=1,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eece5be982b434daf80b44ec022192e',ramdisk_id='',reservation_id='r-z5t0kqwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1859456269',owner_user_name='tempest-ServerRescueNegativeTestJSON-1859456269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:18:11Z,user_data=None,user_id='fc72634020f043308464eca253691603',uuid=ca69a434-ae39-4400-a07f-b49c41f99e84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converting VIF {"id": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "address": "fa:16:3e:3a:d0:81", "network": {"id": "42e2540b-cb56-4a2c-a247-12bc6b44089d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-743925006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eece5be982b434daf80b44ec022192e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd6daa1-d3", "ovs_interfaceid": "9bd6daa1-d3d3-4ce7-99c4-c8f80474e061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG os_vif [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bd6daa1-d3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:39 user nova-compute[73158]: INFO os_vif [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d0:81,bridge_name='br-int',has_traffic_filtering=True,id=9bd6daa1-d3d3-4ce7-99c4-c8f80474e061,network=Network(42e2540b-cb56-4a2c-a247-12bc6b44089d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd6daa1-d3')
Aug 17 10:28:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Deleting instance files /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84_del
Aug 17 10:28:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Deletion of /opt/stack/data/nova/instances/ca69a434-ae39-4400-a07f-b49c41f99e84_del complete
Aug 17 10:28:40 user nova-compute[73158]: INFO nova.compute.manager [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 17 10:28:40 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:28:40 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:28:40 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:28:40 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:40 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Took 0.64 seconds to deallocate network for instance.
Aug 17 10:28:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268106.0283487, 10c7414f-40f2-46f4-aa1e-e8d8516d0329 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:41 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] VM Stopped (Lifecycle Event)
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1e9f3aab-ff6d-4309-bcad-9cf064e273c0 None None] [instance: 10c7414f-40f2-46f4-aa1e-e8d8516d0329] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:41 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Deleted allocations for instance ca69a434-ae39-4400-a07f-b49c41f99e84
Aug 17 10:28:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-976fce41-eabe-4ade-9844-9be4c8d635a3 tempest-ServerRescueNegativeTestJSON-1859456269 tempest-ServerRescueNegativeTestJSON-1859456269-project-member] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] Acquiring lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] Lock "ca69a434-ae39-4400-a07f-b49c41f99e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] No waiting events found dispatching network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:41 user nova-compute[73158]: WARNING nova.compute.manager [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received unexpected event network-vif-plugged-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 for instance with vm_state deleted and task_state None.
Aug 17 10:28:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6613205-7695-4bd1-93e5-60ba59beab1a req-486764d0-873b-4cbe-9367-17fc4947195a service nova] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Received event network-vif-deleted-9bd6daa1-d3d3-4ce7-99c4-c8f80474e061 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:28:48 user nova-compute[73158]: INFO nova.compute.claims [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Claim successful on node user
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.network.neutron [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:28:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.policy [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1978c81194804f6cbd5e98332c36d19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14552145aeb14d838370c33104ae8374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:28:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Creating image(s)
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "/opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "/opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk 1073741824" returned: 0 in 0.058s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Successfully created port: 924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Cannot resize image /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG nova.objects.instance [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'migration_context' on Instance uuid 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Ensure instance console log exists: /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Successfully updated port: 924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquired lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-changed-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Refreshing instance network info cache due to event network-changed-924f3b37-fb20-47b5-b87f-a0698c15e5b0. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] Acquiring lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updating instance_info_cache with network_info: [{"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Releasing lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Instance network_info: |[{"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] Acquired lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Refreshing network info cache for port 924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Start _get_guest_xml network_info=[{"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:28:50 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:28:50 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1814836093',display_name='tempest-AttachVolumeNegativeTest-server-1814836093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1814836093',id=34,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4iZwfGDgKxxg/nogCuyRP39uDkNzDiJWpC/mCt9kV3iBZi5YyOQTicp79hkbFzEevW93TX5ZKGJ0V4HNmf/nt8+k6dio/t33FmX+c8PaQv+TSIOCz7UVqTnZ+oonuXyA==',key_name='tempest-keypair-1465180077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-c8tsk48b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=45cc3b42-7852-45ed-b21d-a77a6e588b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'pci_devices' on Instance uuid 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:28:50 user nova-compute[73158]:   <uuid>45cc3b42-7852-45ed-b21d-a77a6e588b10</uuid>
Aug 17 10:28:50 user nova-compute[73158]:   <name>instance-00000022</name>
Aug 17 10:28:50 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:28:50 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:28:50 user nova-compute[73158]:   <metadata>
Aug 17 10:28:50 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:28:50 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:28:50 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1814836093</nova:name>
Aug 17 10:28:50 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:28:50</nova:creationTime>
Aug 17 10:28:50 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:28:50 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:28:50 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:28:50 user nova-compute[73158]:       <nova:owner>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:user uuid="1978c81194804f6cbd5e98332c36d19d">tempest-AttachVolumeNegativeTest-1781394635-project-member</nova:user>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:project uuid="14552145aeb14d838370c33104ae8374">tempest-AttachVolumeNegativeTest-1781394635</nova:project>
Aug 17 10:28:50 user nova-compute[73158]:       </nova:owner>
Aug 17 10:28:50 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:28:50 user nova-compute[73158]:       <nova:ports>
Aug 17 10:28:50 user nova-compute[73158]:         <nova:port uuid="924f3b37-fb20-47b5-b87f-a0698c15e5b0">
Aug 17 10:28:50 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:28:50 user nova-compute[73158]:         </nova:port>
Aug 17 10:28:50 user nova-compute[73158]:       </nova:ports>
Aug 17 10:28:50 user nova-compute[73158]:     </nova:instance>
Aug 17 10:28:50 user nova-compute[73158]:   </metadata>
Aug 17 10:28:50 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:28:50 user nova-compute[73158]:     <system>
Aug 17 10:28:50 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:28:50 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:28:50 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:28:50 user nova-compute[73158]:       <entry name="serial">45cc3b42-7852-45ed-b21d-a77a6e588b10</entry>
Aug 17 10:28:50 user nova-compute[73158]:       <entry name="uuid">45cc3b42-7852-45ed-b21d-a77a6e588b10</entry>
Aug 17 10:28:50 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:28:50 user nova-compute[73158]:     </system>
Aug 17 10:28:50 user nova-compute[73158]:   </sysinfo>
Aug 17 10:28:50 user nova-compute[73158]:   <os>
Aug 17 10:28:50 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:28:50 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:28:50 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:28:50 user nova-compute[73158]:   </os>
Aug 17 10:28:50 user nova-compute[73158]:   <features>
Aug 17 10:28:50 user nova-compute[73158]:     <acpi/>
Aug 17 10:28:50 user nova-compute[73158]:     <apic/>
Aug 17 10:28:50 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:28:50 user nova-compute[73158]:   </features>
Aug 17 10:28:50 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:28:50 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:28:50 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:28:50 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:28:50 user nova-compute[73158]:   </clock>
Aug 17 10:28:50 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:28:50 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:28:50 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:28:50 user nova-compute[73158]:   </cpu>
Aug 17 10:28:50 user nova-compute[73158]:   <devices>
Aug 17 10:28:50 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:28:50 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:28:50 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk"/>
Aug 17 10:28:50 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:28:50 user nova-compute[73158]:     </disk>
Aug 17 10:28:50 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:28:50 user nova-compute[73158]:       <mac address="fa:16:3e:b3:5c:11"/>
Aug 17 10:28:50 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:28:50 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:28:50 user nova-compute[73158]:       <target dev="tap924f3b37-fb"/>
Aug 17 10:28:50 user nova-compute[73158]:     </interface>
Aug 17 10:28:50 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:28:50 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/console.log" append="off"/>
Aug 17 10:28:50 user nova-compute[73158]:     </serial>
Aug 17 10:28:50 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:28:50 user nova-compute[73158]:     <video>
Aug 17 10:28:50 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:28:50 user nova-compute[73158]:     </video>
Aug 17 10:28:50 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:28:50 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:28:50 user nova-compute[73158]:     </rng>
Aug 17 10:28:50 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:28:50 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:28:50 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:28:50 user nova-compute[73158]:     </memballoon>
Aug 17 10:28:50 user nova-compute[73158]:   </devices>
Aug 17 10:28:50 user nova-compute[73158]: </domain>
Aug 17 10:28:50 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1814836093',display_name='tempest-AttachVolumeNegativeTest-server-1814836093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1814836093',id=34,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4iZwfGDgKxxg/nogCuyRP39uDkNzDiJWpC/mCt9kV3iBZi5YyOQTicp79hkbFzEevW93TX5ZKGJ0V4HNmf/nt8+k6dio/t33FmX+c8PaQv+TSIOCz7UVqTnZ+oonuXyA==',key_name='tempest-keypair-1465180077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-c8tsk48b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=45cc3b42-7852-45ed-b21d-a77a6e588b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG os_vif [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap924f3b37-fb, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap924f3b37-fb, col_values=(('external_ids', {'iface-id': '924f3b37-fb20-47b5-b87f-a0698c15e5b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:5c:11', 'vm-uuid': '45cc3b42-7852-45ed-b21d-a77a6e588b10'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:50 user nova-compute[73158]: INFO os_vif [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb')
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:28:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:b3:5c:11, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:28:51 user nova-compute[73158]: DEBUG nova.network.neutron [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updated VIF entry in instance network info cache for port 924f3b37-fb20-47b5-b87f-a0698c15e5b0. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:28:51 user nova-compute[73158]: DEBUG nova.network.neutron [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updating instance_info_cache with network_info: [{"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:28:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7c349c0f-6bba-40d1-9d4a-32389ad58bb5 req-93d14abb-ea2c-491c-96d5-d7838a772465 service nova] Releasing lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:28:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-739476a3-a20c-45b8-abdb-af1d35e33abf req-a3de988c-53b5-45be-9f4b-802b2a80308c service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-739476a3-a20c-45b8-abdb-af1d35e33abf req-a3de988c-53b5-45be-9f4b-802b2a80308c service nova] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-739476a3-a20c-45b8-abdb-af1d35e33abf req-a3de988c-53b5-45be-9f4b-802b2a80308c service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-739476a3-a20c-45b8-abdb-af1d35e33abf req-a3de988c-53b5-45be-9f4b-802b2a80308c service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-739476a3-a20c-45b8-abdb-af1d35e33abf req-a3de988c-53b5-45be-9f4b-802b2a80308c service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] No waiting events found dispatching network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:52 user nova-compute[73158]: WARNING nova.compute.manager [req-739476a3-a20c-45b8-abdb-af1d35e33abf req-a3de988c-53b5-45be-9f4b-802b2a80308c service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received unexpected event network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 for instance with vm_state building and task_state spawning.
Aug 17 10:28:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268134.4913926, 45cc3b42-7852-45ed-b21d-a77a6e588b10 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] VM Resumed (Lifecycle Event)
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Instance spawned successfully.
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268134.4984508, 45cc3b42-7852-45ed-b21d-a77a6e588b10 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] VM Started (Lifecycle Event)
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-5969c389-b967-4f5b-8bbc-916f7e9d024c req-b37468f5-9f4a-49c7-8fcd-155d8593e20e service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5969c389-b967-4f5b-8bbc-916f7e9d024c req-b37468f5-9f4a-49c7-8fcd-155d8593e20e service nova] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5969c389-b967-4f5b-8bbc-916f7e9d024c req-b37468f5-9f4a-49c7-8fcd-155d8593e20e service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5969c389-b967-4f5b-8bbc-916f7e9d024c req-b37468f5-9f4a-49c7-8fcd-155d8593e20e service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-5969c389-b967-4f5b-8bbc-916f7e9d024c req-b37468f5-9f4a-49c7-8fcd-155d8593e20e service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] No waiting events found dispatching network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:28:54 user nova-compute[73158]: WARNING nova.compute.manager [req-5969c389-b967-4f5b-8bbc-916f7e9d024c req-b37468f5-9f4a-49c7-8fcd-155d8593e20e service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received unexpected event network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 for instance with vm_state building and task_state spawning.
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Took 6.73 seconds to build instance.
Aug 17 10:28:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-758eed66-11c8-4567-bd50-7c909f593099 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.838s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268119.828396, ca69a434-ae39-4400-a07f-b49c41f99e84 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:28:54 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] VM Stopped (Lifecycle Event)
Aug 17 10:28:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-282c7964-88eb-4206-8863-3a3307a5c3e4 None None] [instance: ca69a434-ae39-4400-a07f-b49c41f99e84] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:28:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:28:56 user nova-compute[73158]: INFO nova.compute.manager [None req-430d693b-1318-4c58-9b81-01659975d169 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Get console output
Aug 17 10:28:56 user nova-compute[73158]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 10:28:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:02 user nova-compute[73158]: INFO nova.compute.manager [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Terminating instance
Aug 17 10:29:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-5bd560fe-fd5f-41f9-84c6-73f85beb65cd req-3a1acfad-7936-48b2-b503-8934d40d0909 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-unplugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5bd560fe-fd5f-41f9-84c6-73f85beb65cd req-3a1acfad-7936-48b2-b503-8934d40d0909 service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5bd560fe-fd5f-41f9-84c6-73f85beb65cd req-3a1acfad-7936-48b2-b503-8934d40d0909 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5bd560fe-fd5f-41f9-84c6-73f85beb65cd req-3a1acfad-7936-48b2-b503-8934d40d0909 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-5bd560fe-fd5f-41f9-84c6-73f85beb65cd req-3a1acfad-7936-48b2-b503-8934d40d0909 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-unplugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-5bd560fe-fd5f-41f9-84c6-73f85beb65cd req-3a1acfad-7936-48b2-b503-8934d40d0909 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-unplugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:29:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Instance destroyed successfully.
Aug 17 10:29:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'resources' on Instance uuid 18c69e67-2459-4e44-b6cb-0321b02259a3 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-587024482',display_name='tempest-TestMinimumBasicScenario-server-587024482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-587024482',id=29,image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8FVbmx+kb9yEUO9ShiA8PDyvF3awL3M5GGHQMeJ6cvLiCiq2GvBkb4I6zdhk86CKHLLxrbVf+Xuafinn96NHTuiqljroLITC4F5jmg4zNK93DW3UdMVk4mp66Y2ngJpQ==',key_name='tempest-TestMinimumBasicScenario-252178196',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-p22xgs3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='461989d1-6cc1-4277-a439-b06c387cdaa1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:26:14Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=18c69e67-2459-4e44-b6cb-0321b02259a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "address": "fa:16:3e:6e:1d:71", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e0222d-04", "ovs_interfaceid": "00e0222d-048b-4880-a9e1-0c4dec6749e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG os_vif [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00e0222d-04, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:29:03 user nova-compute[73158]: INFO os_vif [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=00e0222d-048b-4880-a9e1-0c4dec6749e8,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e0222d-04')
Aug 17 10:29:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Deleting instance files /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3_del
Aug 17 10:29:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Deletion of /opt/stack/data/nova/instances/18c69e67-2459-4e44-b6cb-0321b02259a3_del complete
Aug 17 10:29:03 user nova-compute[73158]: INFO nova.compute.manager [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 10:29:03 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:29:03 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:04 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Took 0.63 seconds to deallocate network for instance.
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-6bfba1d9-ef0f-4cc2-b637-8a511cfcde3f req-1aedc13e-a636-4e15-a4c6-6024da2d0e53 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-deleted-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:04 user nova-compute[73158]: INFO nova.compute.manager [req-6bfba1d9-ef0f-4cc2-b637-8a511cfcde3f req-1aedc13e-a636-4e15-a4c6-6024da2d0e53 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Neutron deleted interface 00e0222d-048b-4880-a9e1-0c4dec6749e8; detaching it from the instance and deleting it from the info cache
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-6bfba1d9-ef0f-4cc2-b637-8a511cfcde3f req-1aedc13e-a636-4e15-a4c6-6024da2d0e53 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-6bfba1d9-ef0f-4cc2-b637-8a511cfcde3f req-1aedc13e-a636-4e15-a4c6-6024da2d0e53 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Detach interface failed, port_id=00e0222d-048b-4880-a9e1-0c4dec6749e8, reason: Instance 18c69e67-2459-4e44-b6cb-0321b02259a3 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:04 user nova-compute[73158]: INFO nova.compute.manager [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Terminating instance
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:04 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Deleted allocations for instance 18c69e67-2459-4e44-b6cb-0321b02259a3
Aug 17 10:29:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-72496681-9950-400b-bfc2-891abd87c7f6 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.379s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Instance destroyed successfully.
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'resources' on Instance uuid a6744f73-a7ec-4388-8e15-c05068041a09 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347333996',display_name='tempest-AttachVolumeTestJSON-server-1347333996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347333996',id=23,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPheepqcUNXbTzQftuila4PCt7GH5t9lb7Af45FiVwX63owQW4xVnDg2SSBAJuYLmLnsLfSeurA+C0zGmMOuGSvdKJed87K9UhT5+iBazoL/rWjxBlTWINo0W21VBQidiA==',key_name='tempest-keypair-247187948',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-owzgg4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a6744f73-a7ec-4388-8e15-c05068041a09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "e4639473-b396-4d8c-aadc-30d8e10252cb", "address": "fa:16:3e:c1:86:11", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4639473-b3", "ovs_interfaceid": "e4639473-b396-4d8c-aadc-30d8e10252cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG os_vif [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4639473-b3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-f8600e2a-5ccd-4b5b-b4c9-c237c77ca6fb req-a35a6af2-1170-450f-a088-efef7e5ef927 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f8600e2a-5ccd-4b5b-b4c9-c237c77ca6fb req-a35a6af2-1170-450f-a088-efef7e5ef927 service nova] Acquiring lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f8600e2a-5ccd-4b5b-b4c9-c237c77ca6fb req-a35a6af2-1170-450f-a088-efef7e5ef927 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f8600e2a-5ccd-4b5b-b4c9-c237c77ca6fb req-a35a6af2-1170-450f-a088-efef7e5ef927 service nova] Lock "18c69e67-2459-4e44-b6cb-0321b02259a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-f8600e2a-5ccd-4b5b-b4c9-c237c77ca6fb req-a35a6af2-1170-450f-a088-efef7e5ef927 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] No waiting events found dispatching network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:05 user nova-compute[73158]: WARNING nova.compute.manager [req-f8600e2a-5ccd-4b5b-b4c9-c237c77ca6fb req-a35a6af2-1170-450f-a088-efef7e5ef927 service nova] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Received unexpected event network-vif-plugged-00e0222d-048b-4880-a9e1-0c4dec6749e8 for instance with vm_state deleted and task_state None.
Aug 17 10:29:05 user nova-compute[73158]: INFO os_vif [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:86:11,bridge_name='br-int',has_traffic_filtering=True,id=e4639473-b396-4d8c-aadc-30d8e10252cb,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4639473-b3')
Aug 17 10:29:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Deleting instance files /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09_del
Aug 17 10:29:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Deletion of /opt/stack/data/nova/instances/a6744f73-a7ec-4388-8e15-c05068041a09_del complete
Aug 17 10:29:05 user nova-compute[73158]: INFO nova.compute.manager [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 17 10:29:05 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:29:05 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:29:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:07 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Took 1.79 seconds to deallocate network for instance.
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-41dcd605-5557-47ad-88a2-566afa54d1fc req-4af36e1e-f2ed-438d-9970-ca72045a5dc9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-deleted-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:07 user nova-compute[73158]: INFO nova.compute.manager [req-41dcd605-5557-47ad-88a2-566afa54d1fc req-4af36e1e-f2ed-438d-9970-ca72045a5dc9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Neutron deleted interface e4639473-b396-4d8c-aadc-30d8e10252cb; detaching it from the instance and deleting it from the info cache
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-41dcd605-5557-47ad-88a2-566afa54d1fc req-4af36e1e-f2ed-438d-9970-ca72045a5dc9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-41dcd605-5557-47ad-88a2-566afa54d1fc req-4af36e1e-f2ed-438d-9970-ca72045a5dc9 service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Detach interface failed, port_id=e4639473-b396-4d8c-aadc-30d8e10252cb, reason: Instance a6744f73-a7ec-4388-8e15-c05068041a09 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:07 user nova-compute[73158]: WARNING nova.compute.manager [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-unplugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state deleted and task_state None.
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] Acquiring lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] Lock "a6744f73-a7ec-4388-8e15-c05068041a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] No waiting events found dispatching network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:07 user nova-compute[73158]: WARNING nova.compute.manager [req-0ec55059-3259-461e-bf9a-7e36d1dea5b1 req-43093a0b-d2fe-4929-988f-3f267f57615e service nova] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Received unexpected event network-vif-plugged-e4639473-b396-4d8c-aadc-30d8e10252cb for instance with vm_state deleted and task_state None.
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:07 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Deleted allocations for instance a6744f73-a7ec-4388-8e15-c05068041a09
Aug 17 10:29:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2d0bdc1e-734f-4a3d-b51b-e2e2d06b6362 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a6744f73-a7ec-4388-8e15-c05068041a09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.434s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:18 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268143.277038, 18c69e67-2459-4e44-b6cb-0321b02259a3 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:29:18 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] VM Stopped (Lifecycle Event)
Aug 17 10:29:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b9c0ad3d-bc24-486a-879a-f5609c5028e5 None None] [instance: 18c69e67-2459-4e44-b6cb-0321b02259a3] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:20 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268145.236505, a6744f73-a7ec-4388-8e15-c05068041a09 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:29:20 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] VM Stopped (Lifecycle Event)
Aug 17 10:29:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-28bec083-5f6e-45a2-ab84-4ab13f50f0d7 None None] [instance: a6744f73-a7ec-4388-8e15-c05068041a09] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:32 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:29:32 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=24.202579498291016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 204904fe-4ce2-4aff-bd50-c4f79fab6899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:29:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:29:33 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:29:33 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:29:33 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:29:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:35 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:29:35 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:29:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:29:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:45 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:29:45 user nova-compute[73158]: INFO nova.compute.claims [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Claim successful on node user
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:29:46 user nova-compute[73158]: INFO nova.compute.manager [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Rescuing
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.network.neutron [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:29:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:29:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Creating image(s)
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG nova.policy [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbf2fd52d7184d43aa53bf0d9b2afeca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e64443813742dca6185cfd559df272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.257s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk 1073741824" returned: 0 in 0.063s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.network.neutron [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updating instance_info_cache with network_info: [{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Cannot resize image /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.objects.instance [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'migration_context' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Ensure instance console log exists: /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Successfully created port: c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-2e1166b3-9c0f-4f2c-9e5d-64a05b5508af req-3d8af1a4-9896-49b4-a196-d32896474bec service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2e1166b3-9c0f-4f2c-9e5d-64a05b5508af req-3d8af1a4-9896-49b4-a196-d32896474bec service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2e1166b3-9c0f-4f2c-9e5d-64a05b5508af req-3d8af1a4-9896-49b4-a196-d32896474bec service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2e1166b3-9c0f-4f2c-9e5d-64a05b5508af req-3d8af1a4-9896-49b4-a196-d32896474bec service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-2e1166b3-9c0f-4f2c-9e5d-64a05b5508af req-3d8af1a4-9896-49b4-a196-d32896474bec service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:47 user nova-compute[73158]: WARNING nova.compute.manager [req-2e1166b3-9c0f-4f2c-9e5d-64a05b5508af req-3d8af1a4-9896-49b4-a196-d32896474bec service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state active and task_state rescuing.
Aug 17 10:29:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance destroyed successfully.
Aug 17 10:29:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Attempting a stable device rescue
Aug 17 10:29:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73158) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 10:29:48 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance directory exists: not creating {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 10:29:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Creating image(s)
Aug 17 10:29:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "/opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "/opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:48 user nova-compute[73158]: DEBUG nova.objects.instance [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "bc1268f51012ab2a94acd100de30d5302fd6933d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "bc1268f51012ab2a94acd100de30d5302fd6933d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Successfully updated port: c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.part --force-share --output=json" returned: 0 in 0.248s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.virt.images [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] dd06f758-a79c-435a-880f-942858174f24 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.part /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:49 user nova-compute[73158]: WARNING nova.compute.manager [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state active and task_state rescuing.
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-changed-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Refreshing instance network info cache due to event network-changed-c628c076-ee40-421e-99da-03c425aa1599. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:29:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance network_info: |[{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Refreshing network info cache for port c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Start _get_guest_xml network_info=[{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:29:50 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:29:50 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662312586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662312586',id=35,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqzWJjkLs+Um7+LeT0Y1yIZi/Jn7nJMInkGR4GNB3+cgzO9beJMPaRfle2JgEu3GTF3Olpio2eckwGsHhh+lZ3KGPehWAx02cOSKe7vFhTYTqo/cgErNyPkZHml7HuCBA==',key_name='tempest-keypair-1462162459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-teieknqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:29:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=e40b0f21-6d72-42b6-8877-492c974834f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'pci_devices' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:29:50 user nova-compute[73158]:   <uuid>e40b0f21-6d72-42b6-8877-492c974834f4</uuid>
Aug 17 10:29:50 user nova-compute[73158]:   <name>instance-00000023</name>
Aug 17 10:29:50 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:29:50 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:29:50 user nova-compute[73158]:   <metadata>
Aug 17 10:29:50 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:29:50 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:29:50 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-662312586</nova:name>
Aug 17 10:29:50 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:29:50</nova:creationTime>
Aug 17 10:29:50 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:29:50 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:29:50 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:29:50 user nova-compute[73158]:       <nova:owner>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:user uuid="cbf2fd52d7184d43aa53bf0d9b2afeca">tempest-AttachVolumeShelveTestJSON-1136258329-project-member</nova:user>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:project uuid="26e64443813742dca6185cfd559df272">tempest-AttachVolumeShelveTestJSON-1136258329</nova:project>
Aug 17 10:29:50 user nova-compute[73158]:       </nova:owner>
Aug 17 10:29:50 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:29:50 user nova-compute[73158]:       <nova:ports>
Aug 17 10:29:50 user nova-compute[73158]:         <nova:port uuid="c628c076-ee40-421e-99da-03c425aa1599">
Aug 17 10:29:50 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:29:50 user nova-compute[73158]:         </nova:port>
Aug 17 10:29:50 user nova-compute[73158]:       </nova:ports>
Aug 17 10:29:50 user nova-compute[73158]:     </nova:instance>
Aug 17 10:29:50 user nova-compute[73158]:   </metadata>
Aug 17 10:29:50 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:29:50 user nova-compute[73158]:     <system>
Aug 17 10:29:50 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:29:50 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:29:50 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:29:50 user nova-compute[73158]:       <entry name="serial">e40b0f21-6d72-42b6-8877-492c974834f4</entry>
Aug 17 10:29:50 user nova-compute[73158]:       <entry name="uuid">e40b0f21-6d72-42b6-8877-492c974834f4</entry>
Aug 17 10:29:50 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:29:50 user nova-compute[73158]:     </system>
Aug 17 10:29:50 user nova-compute[73158]:   </sysinfo>
Aug 17 10:29:50 user nova-compute[73158]:   <os>
Aug 17 10:29:50 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:29:50 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:29:50 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:29:50 user nova-compute[73158]:   </os>
Aug 17 10:29:50 user nova-compute[73158]:   <features>
Aug 17 10:29:50 user nova-compute[73158]:     <acpi/>
Aug 17 10:29:50 user nova-compute[73158]:     <apic/>
Aug 17 10:29:50 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:29:50 user nova-compute[73158]:   </features>
Aug 17 10:29:50 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:29:50 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:29:50 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:29:50 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:29:50 user nova-compute[73158]:   </clock>
Aug 17 10:29:50 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:29:50 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:29:50 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:29:50 user nova-compute[73158]:   </cpu>
Aug 17 10:29:50 user nova-compute[73158]:   <devices>
Aug 17 10:29:50 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:29:50 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:29:50 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk"/>
Aug 17 10:29:50 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:29:50 user nova-compute[73158]:     </disk>
Aug 17 10:29:50 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:29:50 user nova-compute[73158]:       <mac address="fa:16:3e:40:12:f8"/>
Aug 17 10:29:50 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:29:50 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:29:50 user nova-compute[73158]:       <target dev="tapc628c076-ee"/>
Aug 17 10:29:50 user nova-compute[73158]:     </interface>
Aug 17 10:29:50 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:29:50 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/console.log" append="off"/>
Aug 17 10:29:50 user nova-compute[73158]:     </serial>
Aug 17 10:29:50 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:29:50 user nova-compute[73158]:     <video>
Aug 17 10:29:50 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:29:50 user nova-compute[73158]:     </video>
Aug 17 10:29:50 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:29:50 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:29:50 user nova-compute[73158]:     </rng>
Aug 17 10:29:50 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:29:50 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:29:50 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:29:50 user nova-compute[73158]:     </memballoon>
Aug 17 10:29:50 user nova-compute[73158]:   </devices>
Aug 17 10:29:50 user nova-compute[73158]: </domain>
Aug 17 10:29:50 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662312586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662312586',id=35,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqzWJjkLs+Um7+LeT0Y1yIZi/Jn7nJMInkGR4GNB3+cgzO9beJMPaRfle2JgEu3GTF3Olpio2eckwGsHhh+lZ3KGPehWAx02cOSKe7vFhTYTqo/cgErNyPkZHml7HuCBA==',key_name='tempest-keypair-1462162459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-teieknqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:29:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=e40b0f21-6d72-42b6-8877-492c974834f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_vif [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc628c076-ee, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc628c076-ee, col_values=(('external_ids', {'iface-id': 'c628c076-ee40-421e-99da-03c425aa1599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:12:f8', 'vm-uuid': 'e40b0f21-6d72-42b6-8877-492c974834f4'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:50 user nova-compute[73158]: INFO os_vif [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee')
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.part /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.converted" returned: 0 in 0.563s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No VIF found with MAC fa:16:3e:40:12:f8, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "bc1268f51012ab2a94acd100de30d5302fd6933d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.223s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "bc1268f51012ab2a94acd100de30d5302fd6933d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "bc1268f51012ab2a94acd100de30d5302fd6933d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updated VIF entry in instance network info cache for port c628c076-ee40-421e-99da-03c425aa1599. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c52c4e71-b03b-4ee8-b9e7-46f8dbe76c63 req-65ea9540-c68b-407f-a5ae-a541e2d741c9 service nova] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d,backing_fmt=raw /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d,backing_fmt=raw /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue" returned: 0 in 0.053s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "bc1268f51012ab2a94acd100de30d5302fd6933d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'migration_context' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Start _get_guest_xml network_info=[{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "vif_mac": "fa:16:3e:0e:c7:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd06f758-a79c-435a-880f-942858174f24', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '39495bc2-fabd-4212-af0d-16ab9b3e5c16', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '204904fe-4ce2-4aff-bd50-c4f79fab6899', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4930fdb-0f26-43a2-8ba5-e70d91420838', 'serial': 'c4930fdb-0f26-43a2-8ba5-e70d91420838'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'resources' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'numa_topology' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:50 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:29:50 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:29:50 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:29:50 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:29:50 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a622d30a-5ee4-49b3-86d8-f1e0b2d4e55b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RtSrbwlN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 10:29:50 user nova-compute[73158]: node.name = iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838
Aug 17 10:29:50 user nova-compute[73158]: node.tpgt = -1
Aug 17 10:29:50 user nova-compute[73158]: node.startup = automatic
Aug 17 10:29:50 user nova-compute[73158]: node.leading_login = No
Aug 17 10:29:50 user nova-compute[73158]: iface.iscsi_ifacename = default
Aug 17 10:29:50 user nova-compute[73158]: iface.net_ifacename = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.ipaddress = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.prefix_len = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.hwaddress = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.transport_name = tcp
Aug 17 10:29:50 user nova-compute[73158]: iface.initiatorname = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.vlan_id = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.vlan_priority = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.vlan_state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.iface_num = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.mtu = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.port = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.bootproto = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.subnet_mask = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.gateway = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_alt_client_id = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_dns = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_learn_iqn = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_vendor_id_state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_vendor_id = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.dhcp_slp_da = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.fragmentation = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.gratuitous_arp = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.incoming_forwarding = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.tos_state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.tos = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.ttl = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.delayed_ack = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.tcp_nagle = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.tcp_wsf_state = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.tcp_wsf = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.tcp_timer_scale = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.tcp_timestamp = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.redirect = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.def_task_mgmt_timeout = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.header_digest = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.data_digest = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.immediate_data = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.initial_r2t = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.data_seq_inorder = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.data_pdu_inorder = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.erl = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.max_receive_data_len = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.first_burst_len = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.max_outstanding_r2t = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.max_burst_len = 0
Aug 17 10:29:50 user nova-compute[73158]: iface.chap_auth = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.bidi_chap = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.strict_login_compliance = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.discovery_auth = <empty>
Aug 17 10:29:50 user nova-compute[73158]: iface.discovery_logout = <empty>
Aug 17 10:29:50 user nova-compute[73158]: node.discovery_address = <empty>
Aug 17 10:29:50 user nova-compute[73158]: node.discovery_port = 0
Aug 17 10:29:50 user nova-compute[73158]: node.discovery_type = static
Aug 17 10:29:50 user nova-compute[73158]: node.session.initial_cmdsn = 0
Aug 17 10:29:50 user nova-compute[73158]: node.session.initial_login_retry_max = 8
Aug 17 10:29:50 user nova-compute[73158]: node.session.xmit_thread_priority = -20
Aug 17 10:29:50 user nova-compute[73158]: node.session.cmds_max = 128
Aug 17 10:29:50 user nova-compute[73158]: node.session.queue_depth = 32
Aug 17 10:29:50 user nova-compute[73158]: node.session.nr_sessions = 1
Aug 17 10:29:50 user nova-compute[73158]: node.session.auth.authmethod = CHAP
Aug 17 10:29:50 user nova-compute[73158]: node.session.auth.username = RtSrbwlN
Aug 17 10:29:50 user nova-compute[73158]: node.session.auth.password = ***
Aug 17 10:29:50 user nova-compute[73158]: node.session.auth.username_in = <empty>
Aug 17 10:29:50 user nova-compute[73158]: node.session.auth.password_in = <empty>
Aug 17 10:29:50 user nova-compute[73158]: node.session.auth.chap_algs = MD5
Aug 17 10:29:50 user nova-compute[73158]: node.session.timeo.replacement_timeout = 120
Aug 17 10:29:50 user nova-compute[73158]: node.session.err_timeo.abort_timeout = 15
Aug 17 10:29:50 user nova-compute[73158]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 10:29:50 user nova-compute[73158]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 10:29:50 user nova-compute[73158]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.FastAbort = Yes
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.InitialR2T = No
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.ImmediateData = Yes
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.MaxConnections = 1
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 10:29:50 user nova-compute[73158]: node.session.iscsi.ERL = 0
Aug 17 10:29:50 user nova-compute[73158]: node.session.scan = manual
Aug 17 10:29:50 user nova-compute[73158]: node.session.reopen_max = 0
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].address = 172.16.0.220
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].port = 3260
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].startup = manual
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].tcp.window_size = 524288
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].tcp.type_of_service = 0
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].timeo.logout_timeout = 15
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].timeo.login_timeout = 15
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].timeo.auth_timeout = 45
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].iscsi.DataDigest = None
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].iscsi.IFMarker = No
Aug 17 10:29:50 user nova-compute[73158]: node.conn[0].iscsi.OFMarker = No
Aug 17 10:29:50 user nova-compute[73158]: # END RECORD
Aug 17 10:29:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33da64e-2229-40f8-a89a-c09411ddc188]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6763777f-969a-4ed6-a3a9-c641b1a45439]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtSrbwlN {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtSrbwlN" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7f38e1-7bee-4f6b-be96-4fa34a3f551a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtSrbwlN'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f3c53-f0b4-4c0d-8094-dd8b5c6d87f1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[532c740c-a781-4761-9cf1-c6117f687a38]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:29:50 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:29:50 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:29:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:29:50 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:29:50 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:29:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] HCTL ('33', '0', '0', 0) found on session 35 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e5fcc8-c810-4eb1-b430-fdc4171b76ae]: (4, ('0 0 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Searching for a device in session 35 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26564333465656135', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:29:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564333465656135', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:27:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127959669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127959669',id=33,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:28:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-mda99a1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:28:24Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=204904fe-4ce2-4aff-bd50-c4f79fab6899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "vif_mac": "fa:16:3e:0e:c7:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "vif_mac": "fa:16:3e:0e:c7:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'pci_devices' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:29:51 user nova-compute[73158]:   <uuid>204904fe-4ce2-4aff-bd50-c4f79fab6899</uuid>
Aug 17 10:29:51 user nova-compute[73158]:   <name>instance-00000021</name>
Aug 17 10:29:51 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:29:51 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:29:51 user nova-compute[73158]:   <metadata>
Aug 17 10:29:51 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:29:51 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:29:51 user nova-compute[73158]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-127959669</nova:name>
Aug 17 10:29:51 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:29:50</nova:creationTime>
Aug 17 10:29:51 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:29:51 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:29:51 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:29:51 user nova-compute[73158]:       <nova:owner>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:user uuid="9bfd8d8513d24d0d893689d5db089546">tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member</nova:user>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:project uuid="9bbba4c18d534970a667590744f891a2">tempest-ServerBootFromVolumeStableRescueTest-184800752</nova:project>
Aug 17 10:29:51 user nova-compute[73158]:       </nova:owner>
Aug 17 10:29:51 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:29:51 user nova-compute[73158]:       <nova:ports>
Aug 17 10:29:51 user nova-compute[73158]:         <nova:port uuid="c2d13c32-7396-494d-8548-94f9beea394a">
Aug 17 10:29:51 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:29:51 user nova-compute[73158]:         </nova:port>
Aug 17 10:29:51 user nova-compute[73158]:       </nova:ports>
Aug 17 10:29:51 user nova-compute[73158]:     </nova:instance>
Aug 17 10:29:51 user nova-compute[73158]:   </metadata>
Aug 17 10:29:51 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:29:51 user nova-compute[73158]:     <system>
Aug 17 10:29:51 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:29:51 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:29:51 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:29:51 user nova-compute[73158]:       <entry name="serial">204904fe-4ce2-4aff-bd50-c4f79fab6899</entry>
Aug 17 10:29:51 user nova-compute[73158]:       <entry name="uuid">204904fe-4ce2-4aff-bd50-c4f79fab6899</entry>
Aug 17 10:29:51 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:29:51 user nova-compute[73158]:     </system>
Aug 17 10:29:51 user nova-compute[73158]:   </sysinfo>
Aug 17 10:29:51 user nova-compute[73158]:   <os>
Aug 17 10:29:51 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:29:51 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:29:51 user nova-compute[73158]:   </os>
Aug 17 10:29:51 user nova-compute[73158]:   <features>
Aug 17 10:29:51 user nova-compute[73158]:     <acpi/>
Aug 17 10:29:51 user nova-compute[73158]:     <apic/>
Aug 17 10:29:51 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:29:51 user nova-compute[73158]:   </features>
Aug 17 10:29:51 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:29:51 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:29:51 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:29:51 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:29:51 user nova-compute[73158]:   </clock>
Aug 17 10:29:51 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:29:51 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:29:51 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:29:51 user nova-compute[73158]:   </cpu>
Aug 17 10:29:51 user nova-compute[73158]:   <devices>
Aug 17 10:29:51 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:29:51 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:29:51 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:29:51 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:29:51 user nova-compute[73158]:       <serial>c4930fdb-0f26-43a2-8ba5-e70d91420838</serial>
Aug 17 10:29:51 user nova-compute[73158]:     </disk>
Aug 17 10:29:51 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:29:51 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:29:51 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue"/>
Aug 17 10:29:51 user nova-compute[73158]:       <target dev="vdb" bus="virtio"/>
Aug 17 10:29:51 user nova-compute[73158]:       <boot order="1"/>
Aug 17 10:29:51 user nova-compute[73158]:     </disk>
Aug 17 10:29:51 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:29:51 user nova-compute[73158]:       <mac address="fa:16:3e:0e:c7:27"/>
Aug 17 10:29:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:29:51 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:29:51 user nova-compute[73158]:       <target dev="tapc2d13c32-73"/>
Aug 17 10:29:51 user nova-compute[73158]:     </interface>
Aug 17 10:29:51 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:29:51 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/console.log" append="off"/>
Aug 17 10:29:51 user nova-compute[73158]:     </serial>
Aug 17 10:29:51 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:29:51 user nova-compute[73158]:     <video>
Aug 17 10:29:51 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:29:51 user nova-compute[73158]:     </video>
Aug 17 10:29:51 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:29:51 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:29:51 user nova-compute[73158]:     </rng>
Aug 17 10:29:51 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:29:51 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:29:51 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:29:51 user nova-compute[73158]:     </memballoon>
Aug 17 10:29:51 user nova-compute[73158]:   </devices>
Aug 17 10:29:51 user nova-compute[73158]: </domain>
Aug 17 10:29:51 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:29:51 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance destroyed successfully.
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] No VIF found with MAC fa:16:3e:0e:c7:27, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:29:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-24565f91-af23-400c-bdd8-56a11fbd5a2c req-4d4ff61b-f158-483b-9798-c3802a067ad8 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-24565f91-af23-400c-bdd8-56a11fbd5a2c req-4d4ff61b-f158-483b-9798-c3802a067ad8 service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-24565f91-af23-400c-bdd8-56a11fbd5a2c req-4d4ff61b-f158-483b-9798-c3802a067ad8 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-24565f91-af23-400c-bdd8-56a11fbd5a2c req-4d4ff61b-f158-483b-9798-c3802a067ad8 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-24565f91-af23-400c-bdd8-56a11fbd5a2c req-4d4ff61b-f158-483b-9798-c3802a067ad8 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:52 user nova-compute[73158]: WARNING nova.compute.manager [req-24565f91-af23-400c-bdd8-56a11fbd5a2c req-4d4ff61b-f158-483b-9798-c3802a067ad8 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state building and task_state spawning.
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:54 user nova-compute[73158]: WARNING nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state building and task_state spawning.
Aug 17 10:29:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:54 user nova-compute[73158]: WARNING nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state active and task_state rescuing.
Aug 17 10:29:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:54 user nova-compute[73158]: WARNING nova.compute.manager [req-1caaea30-f1df-4419-aa1b-8ff8cf8324d0 req-356c9a73-06af-4c7b-990e-10e6e0b4a16e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state active and task_state rescuing.
Aug 17 10:29:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268195.7388663, e40b0f21-6d72-42b6-8877-492c974834f4 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] VM Resumed (Lifecycle Event)
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-837c0d77-8614-43d0-813a-b5388f446f0d tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance spawned successfully.
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268195.7424245, e40b0f21-6d72-42b6-8877-492c974834f4 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] VM Started (Lifecycle Event)
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 204904fe-4ce2-4aff-bd50-c4f79fab6899 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268195.7425854, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Resumed (Lifecycle Event)
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Took 9.54 seconds to spawn the instance on the hypervisor.
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:29:55 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268195.7429636, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:29:55 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Started (Lifecycle Event)
Aug 17 10:29:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:29:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:29:56 user nova-compute[73158]: INFO nova.compute.manager [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Took 10.32 seconds to build instance.
Aug 17 10:29:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cfe21a72-27ed-4a8a-82a3-6f6697e5150b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.422s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:29:57 user nova-compute[73158]: INFO nova.compute.claims [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Claim successful on node user
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:57 user nova-compute[73158]: INFO nova.compute.manager [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Terminating instance
Aug 17 10:29:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-bdc16537-d1ce-4847-ac64-3b4724ddd328 req-64630581-0c96-4e45-aaca-642bff83dc2b service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-unplugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bdc16537-d1ce-4847-ac64-3b4724ddd328 req-64630581-0c96-4e45-aaca-642bff83dc2b service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bdc16537-d1ce-4847-ac64-3b4724ddd328 req-64630581-0c96-4e45-aaca-642bff83dc2b service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bdc16537-d1ce-4847-ac64-3b4724ddd328 req-64630581-0c96-4e45-aaca-642bff83dc2b service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-bdc16537-d1ce-4847-ac64-3b4724ddd328 req-64630581-0c96-4e45-aaca-642bff83dc2b service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-unplugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-bdc16537-d1ce-4847-ac64-3b4724ddd328 req-64630581-0c96-4e45-aaca-642bff83dc2b service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-unplugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.847s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:29:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:29:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Instance destroyed successfully.
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'resources' on Instance uuid 008cc48e-5db1-4f5d-b133-e9577cabe4f8 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-796905679',display_name='tempest-ServerActionsTestOtherA-server-796905679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-796905679',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:25:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-5t2q7aa8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=008cc48e-5db1-4f5d-b133-e9577cabe4f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "address": "fa:16:3e:58:e0:cd", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575c37dd-57", "ovs_interfaceid": "575c37dd-5734-46db-9e11-58ff9dd0b1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG os_vif [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:29:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Creating image(s)
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "/opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "/opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "/opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "87d320151565e5669b57047bf92f51508d51ac17" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "87d320151565e5669b57047bf92f51508d51ac17" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap575c37dd-57, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.policy [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9e11c73731047a6990c618c2f7fe6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb69e4c9da4d2d9403e97e35033f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:29:58 user nova-compute[73158]: INFO os_vif [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=575c37dd-5734-46db-9e11-58ff9dd0b1e0,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575c37dd-57')
Aug 17 10:29:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFenDGUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:29:58 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:29:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c622c-99ca-4331-935e-6ba21e1d341f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad3cdb-f263-4139-b22e-48ab17660731]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:29:59 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:29:59 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:29:59 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:29:59 user nova-compute[73158]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef (non-flash)
Aug 17 10:29:59 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:29:59 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c187eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef'): ({'sdd'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Removing single pathed devices sdd {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924aadb-b639-4463-bfba-446ac7f7258b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8f4de6-a614-414b-9bd7-c4fc2718237e]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Flushing IO for device /dev/sdd {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a806983-9e49-46dc-b121-b55986eaf44e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f86d89-1777-4dd2-ac78-cd6d50e7091e]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.part --force-share --output=json" returned: 0 in 0.238s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG nova.virt.images [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] 69899660-4101-481e-9de1-433de5634b21 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.part /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[da25d1cf-514e-4779-b09d-2bfd20374083]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Successfully created port: f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --logout" returned: 0 in 0.181s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617ffd8-8bf4-4293-9a15-c43f84ad2751]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260]
Aug 17 10:29:59 user nova-compute[73158]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef, portal: 172.16.0.220,3260] successful.
Aug 17 10:29:59 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c59f99-32ec-4481-a8d8-85031cc5dfef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d975a92-7ee2-43bc-9c00-fd3dbf1725c5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.097s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] <== disconnect_volume: return (1099ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:29:59 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Deleting instance files /opt/stack/data/nova/instances/008cc48e-5db1-4f5d-b133-e9577cabe4f8_del
Aug 17 10:29:59 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Deletion of /opt/stack/data/nova/instances/008cc48e-5db1-4f5d-b133-e9577cabe4f8_del complete
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.part /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.converted" returned: 0 in 0.366s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:29:59 user nova-compute[73158]: INFO nova.compute.manager [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Took 2.39 seconds to destroy the instance on the hypervisor.
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "87d320151565e5669b57047bf92f51508d51ac17" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.453s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:29:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-317d830f-2940-44d1-a6b5-0ab34c55554a req-d3bf7528-cb4c-4eea-ab67-9ec393084cad service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-317d830f-2940-44d1-a6b5-0ab34c55554a req-d3bf7528-cb4c-4eea-ab67-9ec393084cad service nova] Acquiring lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-317d830f-2940-44d1-a6b5-0ab34c55554a req-d3bf7528-cb4c-4eea-ab67-9ec393084cad service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-317d830f-2940-44d1-a6b5-0ab34c55554a req-d3bf7528-cb4c-4eea-ab67-9ec393084cad service nova] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-317d830f-2940-44d1-a6b5-0ab34c55554a req-d3bf7528-cb4c-4eea-ab67-9ec393084cad service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] No waiting events found dispatching network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:00 user nova-compute[73158]: WARNING nova.compute.manager [req-317d830f-2940-44d1-a6b5-0ab34c55554a req-d3bf7528-cb4c-4eea-ab67-9ec393084cad service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received unexpected event network-vif-plugged-575c37dd-5734-46db-9e11-58ff9dd0b1e0 for instance with vm_state active and task_state deleting.
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 --force-share --output=json" returned: 0 in 0.252s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "87d320151565e5669b57047bf92f51508d51ac17" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "87d320151565e5669b57047bf92f51508d51ac17" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 --force-share --output=json" returned: 0 in 0.231s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17,backing_fmt=raw /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17,backing_fmt=raw /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk 1073741824" returned: 0 in 0.092s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "87d320151565e5669b57047bf92f51508d51ac17" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 --force-share --output=json" returned: 0 in 0.199s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Cannot resize image /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'migration_context' on Instance uuid 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Ensure instance console log exists: /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:30:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:30:01 user nova-compute[73158]: INFO nova.compute.claims [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Claim successful on node user
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Successfully updated port: f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing instance network info cache due to event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:02 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Took 2.52 seconds to deallocate network for instance.
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:30:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance network_info: |[{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Start _get_guest_xml network_info=[{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:29:54Z,direct_url=<?>,disk_format='qcow2',id=69899660-4101-481e-9de1-433de5634b21,min_disk=0,min_ram=0,name='tempest-scenario-img--687609119',owner='beeb69e4c9da4d2d9403e97e35033f1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:29:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '69899660-4101-481e-9de1-433de5634b21'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:30:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:30:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:29:54Z,direct_url=<?>,disk_format='qcow2',id=69899660-4101-481e-9de1-433de5634b21,min_disk=0,min_ram=0,name='tempest-scenario-img--687609119',owner='beeb69e4c9da4d2d9403e97e35033f1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:29:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-83248482',display_name='tempest-TestMinimumBasicScenario-server-83248482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-83248482',id=36,image_ref='69899660-4101-481e-9de1-433de5634b21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaEQ4dJL+lcHNC79J2RKdWn4AN8VjHqqmv+VK2iJMSpRatK5iMm3fICyv3DSdk337kzQehcQ0pBNmBdTVLPtBv94150GktxhNhRTi1Rr6CudKpMsQ6xygQGNKvsmhz2Lw==',key_name='tempest-TestMinimumBasicScenario-557568035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-6scwi4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69899660-4101-481e-9de1-433de5634b21',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:29:58Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=23cda7ce-352a-49e1-886a-bf300b522620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'pci_devices' on Instance uuid 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.policy [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1230fe2ff59346c7a312ef772820cab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ec620087724665b6218bb575bfcbef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:30:02 user nova-compute[73158]:   <uuid>23cda7ce-352a-49e1-886a-bf300b522620</uuid>
Aug 17 10:30:02 user nova-compute[73158]:   <name>instance-00000024</name>
Aug 17 10:30:02 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:30:02 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:30:02 user nova-compute[73158]:   <metadata>
Aug 17 10:30:02 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:30:02 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:30:02 user nova-compute[73158]:       <nova:name>tempest-TestMinimumBasicScenario-server-83248482</nova:name>
Aug 17 10:30:02 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:30:02</nova:creationTime>
Aug 17 10:30:02 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:30:02 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:30:02 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:30:02 user nova-compute[73158]:       <nova:owner>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:user uuid="b9e11c73731047a6990c618c2f7fe6a2">tempest-TestMinimumBasicScenario-1702191441-project-member</nova:user>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:project uuid="beeb69e4c9da4d2d9403e97e35033f1a">tempest-TestMinimumBasicScenario-1702191441</nova:project>
Aug 17 10:30:02 user nova-compute[73158]:       </nova:owner>
Aug 17 10:30:02 user nova-compute[73158]:       <nova:root type="image" uuid="69899660-4101-481e-9de1-433de5634b21"/>
Aug 17 10:30:02 user nova-compute[73158]:       <nova:ports>
Aug 17 10:30:02 user nova-compute[73158]:         <nova:port uuid="f101e01b-d14b-4c39-8bfa-a0d4706cfee7">
Aug 17 10:30:02 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:30:02 user nova-compute[73158]:         </nova:port>
Aug 17 10:30:02 user nova-compute[73158]:       </nova:ports>
Aug 17 10:30:02 user nova-compute[73158]:     </nova:instance>
Aug 17 10:30:02 user nova-compute[73158]:   </metadata>
Aug 17 10:30:02 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:30:02 user nova-compute[73158]:     <system>
Aug 17 10:30:02 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:30:02 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:30:02 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:30:02 user nova-compute[73158]:       <entry name="serial">23cda7ce-352a-49e1-886a-bf300b522620</entry>
Aug 17 10:30:02 user nova-compute[73158]:       <entry name="uuid">23cda7ce-352a-49e1-886a-bf300b522620</entry>
Aug 17 10:30:02 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:30:02 user nova-compute[73158]:     </system>
Aug 17 10:30:02 user nova-compute[73158]:   </sysinfo>
Aug 17 10:30:02 user nova-compute[73158]:   <os>
Aug 17 10:30:02 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:30:02 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:30:02 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:30:02 user nova-compute[73158]:   </os>
Aug 17 10:30:02 user nova-compute[73158]:   <features>
Aug 17 10:30:02 user nova-compute[73158]:     <acpi/>
Aug 17 10:30:02 user nova-compute[73158]:     <apic/>
Aug 17 10:30:02 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:30:02 user nova-compute[73158]:   </features>
Aug 17 10:30:02 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:30:02 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:30:02 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:30:02 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:30:02 user nova-compute[73158]:   </clock>
Aug 17 10:30:02 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:30:02 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:30:02 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:30:02 user nova-compute[73158]:   </cpu>
Aug 17 10:30:02 user nova-compute[73158]:   <devices>
Aug 17 10:30:02 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:30:02 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:30:02 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk"/>
Aug 17 10:30:02 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:30:02 user nova-compute[73158]:     </disk>
Aug 17 10:30:02 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:30:02 user nova-compute[73158]:       <mac address="fa:16:3e:b2:4c:e6"/>
Aug 17 10:30:02 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:30:02 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:30:02 user nova-compute[73158]:       <target dev="tapf101e01b-d1"/>
Aug 17 10:30:02 user nova-compute[73158]:     </interface>
Aug 17 10:30:02 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:30:02 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/console.log" append="off"/>
Aug 17 10:30:02 user nova-compute[73158]:     </serial>
Aug 17 10:30:02 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:30:02 user nova-compute[73158]:     <video>
Aug 17 10:30:02 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:30:02 user nova-compute[73158]:     </video>
Aug 17 10:30:02 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:30:02 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:30:02 user nova-compute[73158]:     </rng>
Aug 17 10:30:02 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:30:02 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:30:02 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:30:02 user nova-compute[73158]:     </memballoon>
Aug 17 10:30:02 user nova-compute[73158]:   </devices>
Aug 17 10:30:02 user nova-compute[73158]: </domain>
Aug 17 10:30:02 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-83248482',display_name='tempest-TestMinimumBasicScenario-server-83248482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-83248482',id=36,image_ref='69899660-4101-481e-9de1-433de5634b21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaEQ4dJL+lcHNC79J2RKdWn4AN8VjHqqmv+VK2iJMSpRatK5iMm3fICyv3DSdk337kzQehcQ0pBNmBdTVLPtBv94150GktxhNhRTi1Rr6CudKpMsQ6xygQGNKvsmhz2Lw==',key_name='tempest-TestMinimumBasicScenario-557568035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-6scwi4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69899660-4101-481e-9de1-433de5634b21',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:29:58Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=23cda7ce-352a-49e1-886a-bf300b522620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG os_vif [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf101e01b-d1, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf101e01b-d1, col_values=(('external_ids', {'iface-id': 'f101e01b-d14b-4c39-8bfa-a0d4706cfee7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:4c:e6', 'vm-uuid': '23cda7ce-352a-49e1-886a-bf300b522620'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:02 user nova-compute[73158]: INFO os_vif [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1')
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:30:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Creating image(s)
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "/opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "/opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:30:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No VIF found with MAC fa:16:3e:b2:4c:e6, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.212s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.275s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:03 user nova-compute[73158]: INFO nova.compute.manager [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Took 1.06 seconds to detach 1 volumes for instance.
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Deleting volume: a2c59f99-32ec-4481-a8d8-85031cc5dfef {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk 1073741824" returned: 0 in 0.087s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.network.neutron [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updated VIF entry in instance network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.network.neutron [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ea2dfb00-c278-42bb-8d40-fbab3348c528 req-8b4c6846-6df0-419c-a55e-e96506a89d7c service nova] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.252s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Successfully created port: 283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Cannot resize image /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'migration_context' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Ensure instance console log exists: /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-d2ff09c6-0d70-419f-a603-1c90b8888a9f req-664af359-ee1c-49ca-bb1d-e8ab8c59eeb4 service nova] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Received event network-vif-deleted-575c37dd-5734-46db-9e11-58ff9dd0b1e0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:04 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Deleted allocations for instance 008cc48e-5db1-4f5d-b133-e9577cabe4f8
Aug 17 10:30:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c5d5583e-0ff9-463a-94c0-8c5289142ad5 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "008cc48e-5db1-4f5d-b133-e9577cabe4f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.945s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Successfully updated port: 283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquired lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:30:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-6da777ad-e524-4a2d-83b9-bebc970f3353 req-d4e47763-e7d1-4324-a1a3-d8d9ffd92ce5 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6da777ad-e524-4a2d-83b9-bebc970f3353 req-d4e47763-e7d1-4324-a1a3-d8d9ffd92ce5 service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6da777ad-e524-4a2d-83b9-bebc970f3353 req-d4e47763-e7d1-4324-a1a3-d8d9ffd92ce5 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6da777ad-e524-4a2d-83b9-bebc970f3353 req-d4e47763-e7d1-4324-a1a3-d8d9ffd92ce5 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-6da777ad-e524-4a2d-83b9-bebc970f3353 req-d4e47763-e7d1-4324-a1a3-d8d9ffd92ce5 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:05 user nova-compute[73158]: WARNING nova.compute.manager [req-6da777ad-e524-4a2d-83b9-bebc970f3353 req-d4e47763-e7d1-4324-a1a3-d8d9ffd92ce5 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state building and task_state spawning.
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updating instance_info_cache with network_info: [{"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Releasing lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Instance network_info: |[{"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Start _get_guest_xml network_info=[{"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:30:05 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:30:05 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214684663',display_name='tempest-AttachVolumeTestJSON-server-1214684663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214684663',id=37,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK2hHJeAVy7tw8djO3U7FbNNZ3tLU0M38XOvUmWMKQmpb3qw6wcaWqNvArWQduavOPJwbT3G6Wu6hW+4iSUEMm2JgG68iqiQFjTT1Nj6rFokjEMHrOFlZqwo8d4MHjlHg==',key_name='tempest-keypair-2111402704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-uk3t1r9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a3227506-f705-4059-aa51-0a2b38a57c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'pci_devices' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:30:05 user nova-compute[73158]:   <uuid>a3227506-f705-4059-aa51-0a2b38a57c30</uuid>
Aug 17 10:30:05 user nova-compute[73158]:   <name>instance-00000025</name>
Aug 17 10:30:05 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:30:05 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:30:05 user nova-compute[73158]:   <metadata>
Aug 17 10:30:05 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:30:05 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:30:05 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeTestJSON-server-1214684663</nova:name>
Aug 17 10:30:05 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:30:05</nova:creationTime>
Aug 17 10:30:05 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:30:05 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:30:05 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:30:05 user nova-compute[73158]:       <nova:owner>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:user uuid="1230fe2ff59346c7a312ef772820cab1">tempest-AttachVolumeTestJSON-1679631742-project-member</nova:user>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:project uuid="d6ec620087724665b6218bb575bfcbef">tempest-AttachVolumeTestJSON-1679631742</nova:project>
Aug 17 10:30:05 user nova-compute[73158]:       </nova:owner>
Aug 17 10:30:05 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:30:05 user nova-compute[73158]:       <nova:ports>
Aug 17 10:30:05 user nova-compute[73158]:         <nova:port uuid="283c4cda-4da6-47c7-ae06-00a45b74678c">
Aug 17 10:30:05 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:30:05 user nova-compute[73158]:         </nova:port>
Aug 17 10:30:05 user nova-compute[73158]:       </nova:ports>
Aug 17 10:30:05 user nova-compute[73158]:     </nova:instance>
Aug 17 10:30:05 user nova-compute[73158]:   </metadata>
Aug 17 10:30:05 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:30:05 user nova-compute[73158]:     <system>
Aug 17 10:30:05 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:30:05 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:30:05 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:30:05 user nova-compute[73158]:       <entry name="serial">a3227506-f705-4059-aa51-0a2b38a57c30</entry>
Aug 17 10:30:05 user nova-compute[73158]:       <entry name="uuid">a3227506-f705-4059-aa51-0a2b38a57c30</entry>
Aug 17 10:30:05 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:30:05 user nova-compute[73158]:     </system>
Aug 17 10:30:05 user nova-compute[73158]:   </sysinfo>
Aug 17 10:30:05 user nova-compute[73158]:   <os>
Aug 17 10:30:05 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:30:05 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:30:05 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:30:05 user nova-compute[73158]:   </os>
Aug 17 10:30:05 user nova-compute[73158]:   <features>
Aug 17 10:30:05 user nova-compute[73158]:     <acpi/>
Aug 17 10:30:05 user nova-compute[73158]:     <apic/>
Aug 17 10:30:05 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:30:05 user nova-compute[73158]:   </features>
Aug 17 10:30:05 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:30:05 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:30:05 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:30:05 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:30:05 user nova-compute[73158]:   </clock>
Aug 17 10:30:05 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:30:05 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:30:05 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:30:05 user nova-compute[73158]:   </cpu>
Aug 17 10:30:05 user nova-compute[73158]:   <devices>
Aug 17 10:30:05 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:30:05 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:30:05 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk"/>
Aug 17 10:30:05 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:30:05 user nova-compute[73158]:     </disk>
Aug 17 10:30:05 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:30:05 user nova-compute[73158]:       <mac address="fa:16:3e:e6:fa:e4"/>
Aug 17 10:30:05 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:30:05 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:30:05 user nova-compute[73158]:       <target dev="tap283c4cda-4d"/>
Aug 17 10:30:05 user nova-compute[73158]:     </interface>
Aug 17 10:30:05 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:30:05 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/console.log" append="off"/>
Aug 17 10:30:05 user nova-compute[73158]:     </serial>
Aug 17 10:30:05 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:30:05 user nova-compute[73158]:     <video>
Aug 17 10:30:05 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:30:05 user nova-compute[73158]:     </video>
Aug 17 10:30:05 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:30:05 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:30:05 user nova-compute[73158]:     </rng>
Aug 17 10:30:05 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:30:05 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:30:05 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:30:05 user nova-compute[73158]:     </memballoon>
Aug 17 10:30:05 user nova-compute[73158]:   </devices>
Aug 17 10:30:05 user nova-compute[73158]: </domain>
Aug 17 10:30:05 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214684663',display_name='tempest-AttachVolumeTestJSON-server-1214684663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214684663',id=37,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK2hHJeAVy7tw8djO3U7FbNNZ3tLU0M38XOvUmWMKQmpb3qw6wcaWqNvArWQduavOPJwbT3G6Wu6hW+4iSUEMm2JgG68iqiQFjTT1Nj6rFokjEMHrOFlZqwo8d4MHjlHg==',key_name='tempest-keypair-2111402704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-uk3t1r9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a3227506-f705-4059-aa51-0a2b38a57c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG os_vif [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap283c4cda-4d, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap283c4cda-4d, col_values=(('external_ids', {'iface-id': '283c4cda-4da6-47c7-ae06-00a45b74678c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:fa:e4', 'vm-uuid': 'a3227506-f705-4059-aa51-0a2b38a57c30'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:30:05 user nova-compute[73158]: INFO os_vif [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d')
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:30:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No VIF found with MAC fa:16:3e:e6:fa:e4, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-changed-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Refreshing instance network info cache due to event network-changed-283c4cda-4da6-47c7-ae06-00a45b74678c. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] Acquiring lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] Acquired lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Refreshing network info cache for port 283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updated VIF entry in instance network info cache for port 283c4cda-4da6-47c7-ae06-00a45b74678c. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updating instance_info_cache with network_info: [{"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-577792e8-7a27-45d7-83ad-348981e12a2f req-bb3fdd0c-204e-4c87-ad8f-33af2090fee2 service nova] Releasing lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:30:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268207.0290325, 23cda7ce-352a-49e1-886a-bf300b522620 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] VM Resumed (Lifecycle Event)
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance spawned successfully.
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268207.0305808, 23cda7ce-352a-49e1-886a-bf300b522620 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] VM Started (Lifecycle Event)
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Took 8.77 seconds to spawn the instance on the hypervisor.
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:07 user nova-compute[73158]: INFO nova.compute.manager [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Took 10.09 seconds to build instance.
Aug 17 10:30:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-74919327-de57-4a6e-b874-3d1f5d53e1de tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.226s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-6ad10765-37f3-4f9a-9d15-b2b594e7e776 req-548000bd-f1f5-4948-8198-26ef54d58654 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6ad10765-37f3-4f9a-9d15-b2b594e7e776 req-548000bd-f1f5-4948-8198-26ef54d58654 service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6ad10765-37f3-4f9a-9d15-b2b594e7e776 req-548000bd-f1f5-4948-8198-26ef54d58654 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6ad10765-37f3-4f9a-9d15-b2b594e7e776 req-548000bd-f1f5-4948-8198-26ef54d58654 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-6ad10765-37f3-4f9a-9d15-b2b594e7e776 req-548000bd-f1f5-4948-8198-26ef54d58654 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:07 user nova-compute[73158]: WARNING nova.compute.manager [req-6ad10765-37f3-4f9a-9d15-b2b594e7e776 req-548000bd-f1f5-4948-8198-26ef54d58654 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state active and task_state None.
Aug 17 10:30:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] No waiting events found dispatching network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:08 user nova-compute[73158]: WARNING nova.compute.manager [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received unexpected event network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c for instance with vm_state building and task_state spawning.
Aug 17 10:30:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] No waiting events found dispatching network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:08 user nova-compute[73158]: WARNING nova.compute.manager [req-bc30ea2f-9ff9-4d89-8c95-7edd6c5176fd req-8e1957b3-d867-40c6-a9ce-66335a315769 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received unexpected event network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c for instance with vm_state building and task_state spawning.
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268209.578326, a3227506-f705-4059-aa51-0a2b38a57c30 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] VM Resumed (Lifecycle Event)
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Instance spawned successfully.
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268209.5825787, a3227506-f705-4059-aa51-0a2b38a57c30 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] VM Started (Lifecycle Event)
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 17 10:30:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:30:09 user nova-compute[73158]: INFO nova.compute.manager [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Took 7.92 seconds to build instance.
Aug 17 10:30:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-50ff4ca7-ea1e-4d04-bd48-54ff92693f14 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.059s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:13 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268198.4108064, 008cc48e-5db1-4f5d-b133-e9577cabe4f8 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:30:13 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] VM Stopped (Lifecycle Event)
Aug 17 10:30:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-26ad2e19-18ac-4275-90ad-ab161312d046 None None] [instance: 008cc48e-5db1-4f5d-b133-e9577cabe4f8] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:30:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:33 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:30:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7448MB free_disk=23.98102569580078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f59460b3-cc6b-49db-b4d7-a86e2006de30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 204904fe-4ce2-4aff-bd50-c4f79fab6899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e40b0f21-6d72-42b6-8877-492c974834f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 23cda7ce-352a-49e1-886a-bf300b522620 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3227506-f705-4059-aa51-0a2b38a57c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:30:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid f59460b3-cc6b-49db-b4d7-a86e2006de30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [{"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f59460b3-cc6b-49db-b4d7-a86e2006de30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:30:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-changed-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Refreshing instance network info cache due to event network-changed-924f3b37-fb20-47b5-b87f-a0698c15e5b0. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] Acquiring lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] Acquired lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Refreshing network info cache for port 924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updated VIF entry in instance network info cache for port 924f3b37-fb20-47b5-b87f-a0698c15e5b0. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG nova.network.neutron [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updating instance_info_cache with network_info: [{"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9d0f6f58-eef8-4646-846e-c4a73d4c1da6 req-4927bc5a-93b3-4387-8ac9-e8af44c716fc service nova] Releasing lock "refresh_cache-45cc3b42-7852-45ed-b21d-a77a6e588b10" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:30:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Attaching volume 83c14600-a308-4c4f-8365-be048dddf077 to /dev/vdb
Aug 17 10:30:43 user nova-compute[73158]: DEBUG os_brick.utils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6161ec8a-c756-4822-b87b-704108df0d19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e018769-c82f-4736-8440-977a78541e82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a72a2-6dd6-4d31-946d-f55e6999d4af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c1bca-3894-47f6-a592-c4858eea17f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:30:43 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:30:43 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f4237c-9e3e-4d25-8e77-caf9a411910d]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG os_brick.utils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:30:43 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updating existing volume attachment record: 144417b2-2425-4cbc-8eba-b6fcc2d43e87 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:30:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiAPCgvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:30:53 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:30:53 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:30:53 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e37d34-1fdc-4aeb-a5f3-9ffbbecbd5c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:30:53 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5fe31-5a73-4ee3-b240-c9f1b3a85001]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077] added
Aug 17 10:30:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fcc0b3-0391-4ac4-90ae-1d0b96b24111]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9107956-1bbc-405d-9ae4-904c626a5137]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IiAPCgvb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IiAPCgvb" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8bd421-5438-4cc4-969d-f858faabc7df]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IiAPCgvb'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ac9ecb-1152-4a8c-b464-8f4f6200c524]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ed8f5-7024-422e-9db3-95cb8f057096]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdebe1c-0188-48a5-b6d9-e3bd8d2586db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260]
Aug 17 10:30:53 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260] successful.
Aug 17 10:30:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67890b-fe26-4d99-a19d-8bfbb1229dee]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b111180e-cb51-47fe-aa8a-8d9a8d957bff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 (non-flash)
Aug 17 10:30:53 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:30:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[99591d6e-3ef5-4261-a870-0e72d1ec2204]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:30:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiAPCgvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26330386465343038', 'path': '/dev/sdd'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330386465343038', 'path': '/dev/sdd'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:30:55 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:30:55 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:30:55 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:30:55 user nova-compute[73158]:   <serial>83c14600-a308-4c4f-8365-be048dddf077</serial>
Aug 17 10:30:55 user nova-compute[73158]: </disk>
Aug 17 10:30:55 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] No VIF found with MAC fa:16:3e:b3:5c:11, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3f35ee7d-b28d-4fc3-bc9c-426f20216279 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.539s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:55 user nova-compute[73158]: INFO nova.compute.manager [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Terminating instance
Aug 17 10:30:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-464bc22f-abd0-45ee-9503-ad054ca02f4a req-7aaf361b-0ef5-4b42-ae2d-a64228769d54 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-vif-unplugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-464bc22f-abd0-45ee-9503-ad054ca02f4a req-7aaf361b-0ef5-4b42-ae2d-a64228769d54 service nova] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-464bc22f-abd0-45ee-9503-ad054ca02f4a req-7aaf361b-0ef5-4b42-ae2d-a64228769d54 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-464bc22f-abd0-45ee-9503-ad054ca02f4a req-7aaf361b-0ef5-4b42-ae2d-a64228769d54 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-464bc22f-abd0-45ee-9503-ad054ca02f4a req-7aaf361b-0ef5-4b42-ae2d-a64228769d54 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] No waiting events found dispatching network-vif-unplugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-464bc22f-abd0-45ee-9503-ad054ca02f4a req-7aaf361b-0ef5-4b42-ae2d-a64228769d54 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-vif-unplugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.compute.manager [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Detaching volume 83c14600-a308-4c4f-8365-be048dddf077
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.virt.block_device [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Attempting to driver detach volume 83c14600-a308-4c4f-8365-be048dddf077 from mountpoint /dev/vdb
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Attempting to detach device vdb from instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:30:56 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:30:56 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:30:56 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:30:56 user nova-compute[73158]:   <serial>83c14600-a308-4c4f-8365-be048dddf077</serial>
Aug 17 10:30:56 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:30:56 user nova-compute[73158]: </disk>
Aug 17 10:30:56 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully detached device vdb from instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 from the persistent domain config.
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:30:56 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:30:56 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:30:56 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:30:56 user nova-compute[73158]:   <serial>83c14600-a308-4c4f-8365-be048dddf077</serial>
Aug 17 10:30:56 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:30:56 user nova-compute[73158]: </disk>
Aug 17 10:30:56 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Instance destroyed successfully.
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.objects.instance [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lazy-loading 'resources' on Instance uuid f59460b3-cc6b-49db-b4d7-a86e2006de30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1508890590',display_name='tempest-ServerActionsTestOtherA-server-1508890590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1508890590',id=4,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL73yg7NYL4LkpZo3jyGxT14+GfiMTUgA/2u/eSpuCKwRDIXORZzLl4Jbj78pKUt6Mf5bvUfsByjmq9DC2xgPkQThzb2MFFrOgOBsRxwMHyOX8/npb6mFYz/dUqrHH+8cA==',key_name='tempest-keypair-1489598446',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44597afe7d404702983ba1555116e936',ramdisk_id='',reservation_id='r-gr6dlspj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1163059526',owner_user_name='tempest-ServerActionsTestOtherA-1163059526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6db6c1120b74ffbb1bf354c509d27ec',uuid=f59460b3-cc6b-49db-b4d7-a86e2006de30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converting VIF {"id": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "address": "fa:16:3e:b3:f9:a0", "network": {"id": "c7781a29-603f-49e6-ba50-e00690e39ce0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-777600357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44597afe7d404702983ba1555116e936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109973c2-4d", "ovs_interfaceid": "109973c2-4d29-48ed-8141-e45dc9ec66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_vif [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap109973c2-4d, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:30:56 user nova-compute[73158]: INFO os_vif [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=109973c2-4d29-48ed-8141-e45dc9ec66f7,network=Network(c7781a29-603f-49e6-ba50-e00690e39ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109973c2-4d')
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Deleting instance files /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30_del
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Deletion of /opt/stack/data/nova/instances/f59460b3-cc6b-49db-b4d7-a86e2006de30_del complete
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.compute.manager [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268256.8939924, 45cc3b42-7852-45ed-b21d-a77a6e588b10 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:30:56 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully detached device vdb from instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 from the live domain config.
Aug 17 10:30:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiAPCgvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:30:56 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cf1737-3b23-46d4-8656-92ed42545f29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b89bf-8459-4a6c-a84b-8860a0cb6830]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:30:56 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:30:56 user nova-compute[73158]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 (non-flash)
Aug 17 10:30:56 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:30:56 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:30:56 user nova-compute[73158]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 (non-flash)
Aug 17 10:30:56 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077'): ({'sdd'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Removing single pathed devices sdd {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c6bb69-6d7c-4a77-891d-374b8b7b4b5e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e5942c-261e-4706-b82b-d93562a5abe8]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Flushing IO for device /dev/sdd {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af879a-3890-4bed-83cd-1ad8bb29edf9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89cd38a-6d1c-4008-8585-380f2093d443]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d8cc8a-5538-493c-adc9-fa9ae4e590ec]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[23320a6b-7326-466b-9b15-183b413ec23f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260]
Aug 17 10:30:57 user nova-compute[73158]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077, portal: 172.16.0.220,3260] successful.
Aug 17 10:30:57 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c14600-a308-4c4f-8365-be048dddf077 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[927b9a4f-81d2-41e2-ba35-71bd15c9f45d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] <== disconnect_volume: return (293ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:30:57 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Took 0.60 seconds to deallocate network for instance.
Aug 17 10:30:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-26e7b379-7859-4474-b094-22173d301da5 req-d7577981-2384-4bb8-9ef6-0ccfa0cceced service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-vif-deleted-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:57 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Deleted allocations for instance f59460b3-cc6b-49db-b4d7-a86e2006de30
Aug 17 10:30:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bf0bdef7-3c46-410e-a41d-ae06c46d88c1 tempest-ServerActionsTestOtherA-1163059526 tempest-ServerActionsTestOtherA-1163059526-project-member] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:57 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'flavor' on Instance uuid 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:30:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d170133c-face-443d-91e3-ce20947ad39e tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.726s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-f5258d19-b242-42be-ac00-bc6a155f580d req-cf5cc43a-3bbb-4ba4-85db-8312691e8226 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received event network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:30:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f5258d19-b242-42be-ac00-bc6a155f580d req-cf5cc43a-3bbb-4ba4-85db-8312691e8226 service nova] Acquiring lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:30:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f5258d19-b242-42be-ac00-bc6a155f580d req-cf5cc43a-3bbb-4ba4-85db-8312691e8226 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:30:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f5258d19-b242-42be-ac00-bc6a155f580d req-cf5cc43a-3bbb-4ba4-85db-8312691e8226 service nova] Lock "f59460b3-cc6b-49db-b4d7-a86e2006de30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:30:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-f5258d19-b242-42be-ac00-bc6a155f580d req-cf5cc43a-3bbb-4ba4-85db-8312691e8226 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] No waiting events found dispatching network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:30:58 user nova-compute[73158]: WARNING nova.compute.manager [req-f5258d19-b242-42be-ac00-bc6a155f580d req-cf5cc43a-3bbb-4ba4-85db-8312691e8226 service nova] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Received unexpected event network-vif-plugged-109973c2-4d29-48ed-8141-e45dc9ec66f7 for instance with vm_state deleted and task_state None.
Aug 17 10:31:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268256.508392, f59460b3-cc6b-49db-b4d7-a86e2006de30 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:31:11 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] VM Stopped (Lifecycle Event)
Aug 17 10:31:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ae76ffa0-6b17-4f06-929b-29bada36892f None None] [instance: f59460b3-cc6b-49db-b4d7-a86e2006de30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:31 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:31:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-changed-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG nova.compute.manager [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Refreshing instance network info cache due to event network-changed-c628c076-ee40-421e-99da-03c425aa1599. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG nova.network.neutron [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Refreshing network info cache for port c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:37 user nova-compute[73158]: INFO nova.compute.manager [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Unrescuing
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquired lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG nova.network.neutron [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updated VIF entry in instance network info cache for port c628c076-ee40-421e-99da-03c425aa1599. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG nova.network.neutron [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:31:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-933bae4b-192c-4ede-9ff3-1e525b6de7de req-d14fa114-3e76-4984-b160-488f1848708b service nova] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:31:38 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:31:38 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7832MB free_disk=23.996932983398438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 204904fe-4ce2-4aff-bd50-c4f79fab6899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 45cc3b42-7852-45ed-b21d-a77a6e588b10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e40b0f21-6d72-42b6-8877-492c974834f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 23cda7ce-352a-49e1-886a-bf300b522620 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3227506-f705-4059-aa51-0a2b38a57c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updating instance_info_cache with network_info: [{"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Releasing lock "refresh_cache-204904fe-4ce2-4aff-bd50-c4f79fab6899" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'flavor' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-27e8aa09-9046-4adc-b993-281383b8d2c8 req-5dbd5dbd-202f-43e0-9a97-0138d44d16e3 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-27e8aa09-9046-4adc-b993-281383b8d2c8 req-5dbd5dbd-202f-43e0-9a97-0138d44d16e3 service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-27e8aa09-9046-4adc-b993-281383b8d2c8 req-5dbd5dbd-202f-43e0-9a97-0138d44d16e3 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-27e8aa09-9046-4adc-b993-281383b8d2c8 req-5dbd5dbd-202f-43e0-9a97-0138d44d16e3 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG nova.compute.manager [req-27e8aa09-9046-4adc-b993-281383b8d2c8 req-5dbd5dbd-202f-43e0-9a97-0138d44d16e3 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:39 user nova-compute[73158]: WARNING nova.compute.manager [req-27e8aa09-9046-4adc-b993-281383b8d2c8 req-5dbd5dbd-202f-43e0-9a97-0138d44d16e3 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:31:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance destroyed successfully.
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updating instance_info_cache with network_info: [{"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-300a9c6a-ed23-494d-8f26-9b5b333273f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:41 user nova-compute[73158]: WARNING nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:41 user nova-compute[73158]: WARNING nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:41 user nova-compute[73158]: WARNING nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:41 user nova-compute[73158]: WARNING nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:41 user nova-compute[73158]: WARNING nova.compute.manager [req-d482e807-c68f-43ad-96d7-9aceffe5f924 req-33292e85-10ad-4417-b7da-b25fb28d38da service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 204904fe-4ce2-4aff-bd50-c4f79fab6899 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268303.1770093, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:31:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Resumed (Lifecycle Event)
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ea79bb89-417b-40fb-919b-36cce68dcd98 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:43 user nova-compute[73158]: WARNING nova.compute.manager [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:43 user nova-compute[73158]: WARNING nova.compute.manager [req-7099dcb8-9449-4b37-9182-f34ea551d31f req-d87ceee3-373a-4436-a359-9c8dae80982e service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state rescued and task_state unrescuing.
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:31:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268303.182454, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:31:43 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Started (Lifecycle Event)
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:43 user nova-compute[73158]: INFO nova.compute.manager [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Shelving
Aug 17 10:31:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:44 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance destroyed successfully.
Aug 17 10:31:44 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Beginning cold snapshot process
Aug 17 10:31:44 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:31:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk /opt/stack/data/nova/instances/snapshots/tmp0c3tyoon/3815ab273e7b4cd995eee27970c98a99 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-unplugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-unplugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:45 user nova-compute[73158]: WARNING nova.compute.manager [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-unplugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 10:31:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:45 user nova-compute[73158]: WARNING nova.compute.manager [req-eeb6dec5-5213-41b3-845f-f84002cbd5c7 req-377cfe70-7b57-4171-819a-af31a018bd0e service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 10:31:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk /opt/stack/data/nova/instances/snapshots/tmp0c3tyoon/3815ab273e7b4cd995eee27970c98a99" returned: 0 in 0.558s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Snapshot extracted, beginning image upload
Aug 17 10:31:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:46 user nova-compute[73158]: INFO nova.compute.manager [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Terminating instance
Aug 17 10:31:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a994ddf-58ce-496a-a66b-c824380963b2 req-4873b124-8369-4741-b51e-93f12c06348f service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-vif-unplugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a994ddf-58ce-496a-a66b-c824380963b2 req-4873b124-8369-4741-b51e-93f12c06348f service nova] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a994ddf-58ce-496a-a66b-c824380963b2 req-4873b124-8369-4741-b51e-93f12c06348f service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a994ddf-58ce-496a-a66b-c824380963b2 req-4873b124-8369-4741-b51e-93f12c06348f service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a994ddf-58ce-496a-a66b-c824380963b2 req-4873b124-8369-4741-b51e-93f12c06348f service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] No waiting events found dispatching network-vif-unplugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a994ddf-58ce-496a-a66b-c824380963b2 req-4873b124-8369-4741-b51e-93f12c06348f service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-vif-unplugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Instance destroyed successfully.
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lazy-loading 'resources' on Instance uuid 45cc3b42-7852-45ed-b21d-a77a6e588b10 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1814836093',display_name='tempest-AttachVolumeNegativeTest-server-1814836093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1814836093',id=34,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4iZwfGDgKxxg/nogCuyRP39uDkNzDiJWpC/mCt9kV3iBZi5YyOQTicp79hkbFzEevW93TX5ZKGJ0V4HNmf/nt8+k6dio/t33FmX+c8PaQv+TSIOCz7UVqTnZ+oonuXyA==',key_name='tempest-keypair-1465180077',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:28:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14552145aeb14d838370c33104ae8374',ramdisk_id='',reservation_id='r-c8tsk48b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1781394635',owner_user_name='tempest-AttachVolumeNegativeTest-1781394635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1978c81194804f6cbd5e98332c36d19d',uuid=45cc3b42-7852-45ed-b21d-a77a6e588b10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converting VIF {"id": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "address": "fa:16:3e:b3:5c:11", "network": {"id": "588bc09c-0f9b-4f67-86ab-da9d1db2d6d4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-324020157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14552145aeb14d838370c33104ae8374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924f3b37-fb", "ovs_interfaceid": "924f3b37-fb20-47b5-b87f-a0698c15e5b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG os_vif [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap924f3b37-fb, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:47 user nova-compute[73158]: INFO os_vif [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:5c:11,bridge_name='br-int',has_traffic_filtering=True,id=924f3b37-fb20-47b5-b87f-a0698c15e5b0,network=Network(588bc09c-0f9b-4f67-86ab-da9d1db2d6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924f3b37-fb')
Aug 17 10:31:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Deleting instance files /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10_del
Aug 17 10:31:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Deletion of /opt/stack/data/nova/instances/45cc3b42-7852-45ed-b21d-a77a6e588b10_del complete
Aug 17 10:31:47 user nova-compute[73158]: INFO nova.compute.manager [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 17 10:31:47 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:31:47 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:31:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Snapshot image upload complete
Aug 17 10:31:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:31:48 user nova-compute[73158]: INFO nova.compute.manager [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Shelve offloading
Aug 17 10:31:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance destroyed successfully.
Aug 17 10:31:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:31:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:31:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:31:48 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:31:49 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Took 1.36 seconds to deallocate network for instance.
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-34410d27-fe64-4587-9360-a4a0315f8ade req-382c48cd-14ef-470e-b453-1512889f61e5 service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-vif-deleted-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-58328b5f-e547-4049-817b-285c2f283f15 req-22ba04d4-2f8a-44d7-b2e3-0ff289a6be1c service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received event network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-58328b5f-e547-4049-817b-285c2f283f15 req-22ba04d4-2f8a-44d7-b2e3-0ff289a6be1c service nova] Acquiring lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-58328b5f-e547-4049-817b-285c2f283f15 req-22ba04d4-2f8a-44d7-b2e3-0ff289a6be1c service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-58328b5f-e547-4049-817b-285c2f283f15 req-22ba04d4-2f8a-44d7-b2e3-0ff289a6be1c service nova] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-58328b5f-e547-4049-817b-285c2f283f15 req-22ba04d4-2f8a-44d7-b2e3-0ff289a6be1c service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] No waiting events found dispatching network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:31:49 user nova-compute[73158]: WARNING nova.compute.manager [req-58328b5f-e547-4049-817b-285c2f283f15 req-22ba04d4-2f8a-44d7-b2e3-0ff289a6be1c service nova] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Received unexpected event network-vif-plugged-924f3b37-fb20-47b5-b87f-a0698c15e5b0 for instance with vm_state deleted and task_state None.
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:49 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Deleted allocations for instance 45cc3b42-7852-45ed-b21d-a77a6e588b10
Aug 17 10:31:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:31:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8ff31da4-9eec-4b36-8a2a-2d314d156070 tempest-AttachVolumeNegativeTest-1781394635 tempest-AttachVolumeNegativeTest-1781394635-project-member] Lock "45cc3b42-7852-45ed-b21d-a77a6e588b10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.010s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:50 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance destroyed successfully.
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'resources' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662312586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662312586',id=35,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqzWJjkLs+Um7+LeT0Y1yIZi/Jn7nJMInkGR4GNB3+cgzO9beJMPaRfle2JgEu3GTF3Olpio2eckwGsHhh+lZ3KGPehWAx02cOSKe7vFhTYTqo/cgErNyPkZHml7HuCBA==',key_name='tempest-keypair-1462162459',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-teieknqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member',shelved_at='2023-08-17T10:31:48.287478',shelved_host='user',shelved_image_id='9874be58-995e-4824-aa3b-64ba048ed199'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=e40b0f21-6d72-42b6-8877-492c974834f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG os_vif [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc628c076-ee, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:31:50 user nova-compute[73158]: INFO os_vif [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee')
Aug 17 10:31:50 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Deleting instance files /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4_del
Aug 17 10:31:50 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Deletion of /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4_del complete
Aug 17 10:31:50 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Deleted allocations for instance e40b0f21-6d72-42b6-8877-492c974834f4
Aug 17 10:31:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'numa_topology' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ff476eb5-f6a7-44a4-90c3-3f3f90f8b0d8 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.249s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-changed-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Refreshing instance network info cache due to event network-changed-283c4cda-4da6-47c7-ae06-00a45b74678c. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] Acquiring lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] Acquired lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG nova.network.neutron [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Refreshing network info cache for port 283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG nova.objects.instance [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'flavor' on Instance uuid 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:53 user nova-compute[73158]: INFO nova.compute.manager [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Attaching volume af601589-c1d6-4075-a923-40505f0ce1b3 to /dev/vdb
Aug 17 10:31:53 user nova-compute[73158]: DEBUG os_brick.utils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57789ce-8ef5-47d4-8286-6abe52652248]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd8d08-02fc-4cfa-ab62-ed721964d480]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac99080f-76c1-4afa-8ab9-cdd952e68887]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e86bf1-6b30-41e1-9c15-55b0ff32ef9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:31:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:31:54 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:31:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6733d84-3179-4975-93b5-3f34b1360a6a]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG os_brick.utils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating existing volume attachment record: eb24ca1c-eb37-4156-a920-cbac136372af {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updated VIF entry in instance network info cache for port 283c4cda-4da6-47c7-ae06-00a45b74678c. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG nova.network.neutron [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updating instance_info_cache with network_info: [{"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:31:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0befba0-e5ac-4774-9a20-a035d0726427 req-9d8f1c03-28bb-4e59-a26c-a41dded2bfae service nova] Releasing lock "refresh_cache-a3227506-f705-4059-aa51-0a2b38a57c30" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:31:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:31:58 user nova-compute[73158]: INFO nova.compute.manager [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attaching volume cb13300e-abd8-41bd-b59d-ddde78ebbcbf to /dev/vdb
Aug 17 10:31:58 user nova-compute[73158]: DEBUG os_brick.utils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013f9f4-9b9a-48cd-aee1-0bb5a25c1a50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7745ea-d3f4-4961-8f10-a79fe69c31d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f8e91f-678c-4a6e-ba80-802da1fc38d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935ee7b-5e7a-4128-85ef-56374999e08f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:31:58 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:31:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7d1ce-82f5-4b69-9225-b75084ccad2e]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG os_brick.utils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:31:58 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updating existing volume attachment record: 43f1421e-8641-45a8-b0e9-a9f477c26775 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:31:59 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268304.5168726, e40b0f21-6d72-42b6-8877-492c974834f4 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:31:59 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] VM Stopped (Lifecycle Event)
Aug 17 10:31:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a650ee80-2612-4a8a-9863-e14cdba20742 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:32:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:32:01 user nova-compute[73158]: INFO nova.compute.claims [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Claim successful on node user
Aug 17 10:32:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.network.neutron [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:32:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268307.5416417, 45cc3b42-7852-45ed-b21d-a77a6e588b10 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:32:02 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] VM Stopped (Lifecycle Event)
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.policy [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '499f77486ae9486990357d021d0a78cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6ce46509014f69a037b59466497704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e0cea1cc-8240-4a3b-b6a2-d5df6d707257 None None] [instance: 45cc3b42-7852-45ed-b21d-a77a6e588b10] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:32:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Creating image(s)
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "/opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "/opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "/opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk 1073741824" returned: 0 in 0.060s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Successfully created port: e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.216s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Cannot resize image /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lazy-loading 'migration_context' on Instance uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Ensure instance console log exists: /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Successfully updated port: e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquired lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-changed-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Refreshing instance network info cache due to event network-changed-e2405fef-c32c-450b-ad59-6435c9f26231. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] Acquiring lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updating instance_info_cache with network_info: [{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Releasing lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Instance network_info: |[{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] Acquired lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Refreshing network info cache for port e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Start _get_guest_xml network_info=[{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:32:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:32:04 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1026638619',display_name='tempest-ServersNegativeTestJSON-server-1026638619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1026638619',id=38,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6ce46509014f69a037b59466497704',ramdisk_id='',reservation_id='r-x0k90pji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2112722000',owner_user_name='tempest-ServersNegativeTestJSON-2112722000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:32:02Z,user_data=None,user_id='499f77486ae9486990357d021d0a78cf',uuid=30084e0f-ca18-4139-94ee-e470214e9b1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converting VIF {"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lazy-loading 'pci_devices' on Instance uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:32:04 user nova-compute[73158]:   <uuid>30084e0f-ca18-4139-94ee-e470214e9b1a</uuid>
Aug 17 10:32:04 user nova-compute[73158]:   <name>instance-00000026</name>
Aug 17 10:32:04 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:32:04 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:32:04 user nova-compute[73158]:   <metadata>
Aug 17 10:32:04 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:32:04 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:32:04 user nova-compute[73158]:       <nova:name>tempest-ServersNegativeTestJSON-server-1026638619</nova:name>
Aug 17 10:32:04 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:32:04</nova:creationTime>
Aug 17 10:32:04 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:32:04 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:32:04 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:32:04 user nova-compute[73158]:       <nova:owner>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:user uuid="499f77486ae9486990357d021d0a78cf">tempest-ServersNegativeTestJSON-2112722000-project-member</nova:user>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:project uuid="4f6ce46509014f69a037b59466497704">tempest-ServersNegativeTestJSON-2112722000</nova:project>
Aug 17 10:32:04 user nova-compute[73158]:       </nova:owner>
Aug 17 10:32:04 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:32:04 user nova-compute[73158]:       <nova:ports>
Aug 17 10:32:04 user nova-compute[73158]:         <nova:port uuid="e2405fef-c32c-450b-ad59-6435c9f26231">
Aug 17 10:32:04 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:32:04 user nova-compute[73158]:         </nova:port>
Aug 17 10:32:04 user nova-compute[73158]:       </nova:ports>
Aug 17 10:32:04 user nova-compute[73158]:     </nova:instance>
Aug 17 10:32:04 user nova-compute[73158]:   </metadata>
Aug 17 10:32:04 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:32:04 user nova-compute[73158]:     <system>
Aug 17 10:32:04 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:32:04 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:32:04 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:32:04 user nova-compute[73158]:       <entry name="serial">30084e0f-ca18-4139-94ee-e470214e9b1a</entry>
Aug 17 10:32:04 user nova-compute[73158]:       <entry name="uuid">30084e0f-ca18-4139-94ee-e470214e9b1a</entry>
Aug 17 10:32:04 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:32:04 user nova-compute[73158]:     </system>
Aug 17 10:32:04 user nova-compute[73158]:   </sysinfo>
Aug 17 10:32:04 user nova-compute[73158]:   <os>
Aug 17 10:32:04 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:32:04 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:32:04 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:32:04 user nova-compute[73158]:   </os>
Aug 17 10:32:04 user nova-compute[73158]:   <features>
Aug 17 10:32:04 user nova-compute[73158]:     <acpi/>
Aug 17 10:32:04 user nova-compute[73158]:     <apic/>
Aug 17 10:32:04 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:32:04 user nova-compute[73158]:   </features>
Aug 17 10:32:04 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:32:04 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:32:04 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:32:04 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:32:04 user nova-compute[73158]:   </clock>
Aug 17 10:32:04 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:32:04 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:32:04 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:32:04 user nova-compute[73158]:   </cpu>
Aug 17 10:32:04 user nova-compute[73158]:   <devices>
Aug 17 10:32:04 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:32:04 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:32:04 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk"/>
Aug 17 10:32:04 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:32:04 user nova-compute[73158]:     </disk>
Aug 17 10:32:04 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:32:04 user nova-compute[73158]:       <mac address="fa:16:3e:b8:07:b7"/>
Aug 17 10:32:04 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:32:04 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:32:04 user nova-compute[73158]:       <target dev="tape2405fef-c3"/>
Aug 17 10:32:04 user nova-compute[73158]:     </interface>
Aug 17 10:32:04 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:32:04 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/console.log" append="off"/>
Aug 17 10:32:04 user nova-compute[73158]:     </serial>
Aug 17 10:32:04 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:32:04 user nova-compute[73158]:     <video>
Aug 17 10:32:04 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:32:04 user nova-compute[73158]:     </video>
Aug 17 10:32:04 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:32:04 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:32:04 user nova-compute[73158]:     </rng>
Aug 17 10:32:04 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:32:04 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:32:04 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:32:04 user nova-compute[73158]:     </memballoon>
Aug 17 10:32:04 user nova-compute[73158]:   </devices>
Aug 17 10:32:04 user nova-compute[73158]: </domain>
Aug 17 10:32:04 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1026638619',display_name='tempest-ServersNegativeTestJSON-server-1026638619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1026638619',id=38,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6ce46509014f69a037b59466497704',ramdisk_id='',reservation_id='r-x0k90pji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2112722000',owner_user_name='tempest-ServersNegativeTestJSON-2112722000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:32:02Z,user_data=None,user_id='499f77486ae9486990357d021d0a78cf',uuid=30084e0f-ca18-4139-94ee-e470214e9b1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converting VIF {"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG os_vif [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2405fef-c3, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2405fef-c3, col_values=(('external_ids', {'iface-id': 'e2405fef-c32c-450b-ad59-6435c9f26231', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:07:b7', 'vm-uuid': '30084e0f-ca18-4139-94ee-e470214e9b1a'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:04 user nova-compute[73158]: INFO os_vif [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3')
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] No VIF found with MAC fa:16:3e:b8:07:b7, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updated VIF entry in instance network info cache for port e2405fef-c32c-450b-ad59-6435c9f26231. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updating instance_info_cache with network_info: [{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c4b94699-cbd6-4a58-a5e0-6bed790182dd req-a0211ac4-4050-4c88-b2cd-5e616996bdbe service nova] Releasing lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wnCYhycr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:32:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:05 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:05 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e610bf28-8e23-413e-abb5-7c12bb25244f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:32:05 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff7d6fe-156f-4618-bb61-3f7f932833ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3] added
Aug 17 10:32:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf3d895-25e4-4c16-9fa4-c6ba0b5ecb15]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa11613-c9ee-4d3d-9beb-fed51dc14719]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wnCYhycr {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wnCYhycr" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241fce6-c902-4ff2-8ae5-a8e49c73f7e8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wnCYhycr'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd5ebee-8f6a-4470-b40a-b15bf25a1f19]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a1132b-292a-40bc-836c-0b6338ccbae0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b164d9b-0e86-4f33-bbac-c4b44de876d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260]
Aug 17 10:32:05 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260] successful.
Aug 17 10:32:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[923dfe03-b1e0-49c8-be51-7f4c962ecafe]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42be85b-00e7-41d5-9395-1474b356e53a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:05 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7040b007-7743-43dc-9619-7bb9dffbc8f6]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wnCYhycr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-2668dc3e-fb6c-42fa-a7b0-269786335f32 req-db9b155e-28c5-42d0-8b40-c8ae8d247eae service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2668dc3e-fb6c-42fa-a7b0-269786335f32 req-db9b155e-28c5-42d0-8b40-c8ae8d247eae service nova] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2668dc3e-fb6c-42fa-a7b0-269786335f32 req-db9b155e-28c5-42d0-8b40-c8ae8d247eae service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2668dc3e-fb6c-42fa-a7b0-269786335f32 req-db9b155e-28c5-42d0-8b40-c8ae8d247eae service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-2668dc3e-fb6c-42fa-a7b0-269786335f32 req-db9b155e-28c5-42d0-8b40-c8ae8d247eae service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] No waiting events found dispatching network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:06 user nova-compute[73158]: WARNING nova.compute.manager [req-2668dc3e-fb6c-42fa-a7b0-269786335f32 req-db9b155e-28c5-42d0-8b40-c8ae8d247eae service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received unexpected event network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 for instance with vm_state building and task_state spawning.
Aug 17 10:32:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23530646430323630', 'path': '/dev/sdd'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530646430323630', 'path': '/dev/sdd'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'flavor' on Instance uuid 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:32:07 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:07 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:32:07 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:32:07 user nova-compute[73158]:   <serial>af601589-c1d6-4075-a923-40505f0ce1b3</serial>
Aug 17 10:32:07 user nova-compute[73158]: </disk>
Aug 17 10:32:07 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] No VIF found with MAC fa:16:3e:b2:4c:e6, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:32:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-96f4a3ff-dde9-45e7-ad3c-648d97434d50 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.808s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268328.4887774, 30084e0f-ca18-4139-94ee-e470214e9b1a => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] VM Resumed (Lifecycle Event)
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Instance spawned successfully.
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc7874dc-d3f3-4d12-aca8-53db56063abc req-5f70e13b-4b3d-49c3-96a0-57132806e693 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc7874dc-d3f3-4d12-aca8-53db56063abc req-5f70e13b-4b3d-49c3-96a0-57132806e693 service nova] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc7874dc-d3f3-4d12-aca8-53db56063abc req-5f70e13b-4b3d-49c3-96a0-57132806e693 service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc7874dc-d3f3-4d12-aca8-53db56063abc req-5f70e13b-4b3d-49c3-96a0-57132806e693 service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc7874dc-d3f3-4d12-aca8-53db56063abc req-5f70e13b-4b3d-49c3-96a0-57132806e693 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] No waiting events found dispatching network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:08 user nova-compute[73158]: WARNING nova.compute.manager [req-fc7874dc-d3f3-4d12-aca8-53db56063abc req-5f70e13b-4b3d-49c3-96a0-57132806e693 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received unexpected event network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 for instance with vm_state building and task_state spawning.
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268328.4909844, 30084e0f-ca18-4139-94ee-e470214e9b1a => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] VM Started (Lifecycle Event)
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 17 10:32:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:32:08 user nova-compute[73158]: INFO nova.compute.manager [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Took 6.84 seconds to build instance.
Aug 17 10:32:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-b40f515e-2f52-4438-8229-9b20119e6eb2 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FjleyAxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:32:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:10 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3867d-6981-451b-a64e-a1936c39ba40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:32:10 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1087e0-664b-4f45-9ec4-cb3b22e64247]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf] added
Aug 17 10:32:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc538db6-d80f-4e90-85dc-7dc1ead7de61]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1a272a-8ef1-461e-beaa-4de0ef6ac2c2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FjleyAxa {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FjleyAxa" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81202b4d-d1e5-4014-bab1-5647be5ece8a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FjleyAxa'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29dae43-18da-4c40-9ef8-1f112aaf453c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a74d12f-c2e5-4e0b-9b39-40638759ebcf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0355627-3e66-40b3-94c8-f5483d1380ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260]
Aug 17 10:32:10 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260] successful.
Aug 17 10:32:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5eee89-1385-4024-8166-68b6546ad111]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing instance network info cache due to event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[61393527-ea9c-4ee6-adf5-0a55578f597f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:10 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[954bd669-1d39-4991-a87f-0d1015aa0519]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG nova.network.neutron [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updated VIF entry in instance network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG nova.network.neutron [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-af8e00c6-36bc-45d6-98df-e3bbd75d32c9 req-04f1fbf6-32a7-4995-b287-cd9b918b2b23 service nova] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FjleyAxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23833373762653861', 'path': '/dev/sde'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833373762653861', 'path': '/dev/sde'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:32:11 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:11 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:32:11 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:32:11 user nova-compute[73158]:   <serial>cb13300e-abd8-41bd-b59d-ddde78ebbcbf</serial>
Aug 17 10:32:11 user nova-compute[73158]: </disk>
Aug 17 10:32:11 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:32:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No VIF found with MAC fa:16:3e:e6:fa:e4, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:32:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c1eae2ca-122c-4c07-87c1-b0d483ebec2a tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.191s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing instance network info cache due to event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:32:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:32:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:32:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updated VIF entry in instance network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d3d00bc-82c4-4f50-9508-10b87bd06efd req-86e71da7-79c7-4f81-bbef-605eac0508b3 service nova] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:14 user nova-compute[73158]: INFO nova.compute.manager [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Rebooting instance
Aug 17 10:32:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:32:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-82e6ae82-8159-4891-af81-da4a88dc5c8d req-f775e6b2-3d1f-450f-8055-7ae6affb214c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-unplugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82e6ae82-8159-4891-af81-da4a88dc5c8d req-f775e6b2-3d1f-450f-8055-7ae6affb214c service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82e6ae82-8159-4891-af81-da4a88dc5c8d req-f775e6b2-3d1f-450f-8055-7ae6affb214c service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-82e6ae82-8159-4891-af81-da4a88dc5c8d req-f775e6b2-3d1f-450f-8055-7ae6affb214c service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-82e6ae82-8159-4891-af81-da4a88dc5c8d req-f775e6b2-3d1f-450f-8055-7ae6affb214c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-unplugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:17 user nova-compute[73158]: WARNING nova.compute.manager [req-82e6ae82-8159-4891-af81-da4a88dc5c8d req-f775e6b2-3d1f-450f-8055-7ae6affb214c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-unplugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state active and task_state reboot_started.
Aug 17 10:32:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance shutdown successfully.
Aug 17 10:32:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:19 user nova-compute[73158]: INFO nova.compute.manager [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attaching volume d8537460-dcd4-4d7c-9724-2cfabecabefa to /dev/vdc
Aug 17 10:32:19 user nova-compute[73158]: DEBUG os_brick.utils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266190b-dee5-400d-89e3-508f865da5b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ac3b9-ee7b-483d-9e03-e32e9e497c76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1708a074-7bbe-4d03-a4fe-6a691d5d0a19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[477e9d62-828b-43d5-88ef-e28cf05b9cc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:32:19 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[806aaec5-5c7a-4df7-a40b-cbea189c3d0f]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG os_brick.utils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updating existing volume attachment record: 28070925-fc57-4636-a44d-4654050dbbf9 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-a3772d32-fa3a-4a44-b952-7c5dbdbcba7c req-544ece7d-e08f-4bef-9357-384a7ac5f03d service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a3772d32-fa3a-4a44-b952-7c5dbdbcba7c req-544ece7d-e08f-4bef-9357-384a7ac5f03d service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a3772d32-fa3a-4a44-b952-7c5dbdbcba7c req-544ece7d-e08f-4bef-9357-384a7ac5f03d service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a3772d32-fa3a-4a44-b952-7c5dbdbcba7c req-544ece7d-e08f-4bef-9357-384a7ac5f03d service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-a3772d32-fa3a-4a44-b952-7c5dbdbcba7c req-544ece7d-e08f-4bef-9357-384a7ac5f03d service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:19 user nova-compute[73158]: WARNING nova.compute.manager [req-a3772d32-fa3a-4a44-b952-7c5dbdbcba7c req-544ece7d-e08f-4bef-9357-384a7ac5f03d service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state active and task_state reboot_started.
Aug 17 10:32:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:21 user nova-compute[73158]: WARNING nova.compute.manager [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state active and task_state reboot_started.
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:21 user nova-compute[73158]: WARNING nova.compute.manager [req-aed48731-0eb4-47d8-ae02-a4af2bbca738 req-4fa7888f-1ce8-4a0b-99e0-064d16e8a1eb service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state active and task_state reboot_started.
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Removed pending event for 23cda7ce-352a-49e1-886a-bf300b522620 due to event {{(pid=73158) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268341.7970316, 23cda7ce-352a-49e1-886a-bf300b522620 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:32:21 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] VM Resumed (Lifecycle Event)
Aug 17 10:32:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance running successfully.
Aug 17 10:32:21 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance soft rebooted successfully.
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:32:21 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268341.7989264, 23cda7ce-352a-49e1-886a-bf300b522620 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:32:21 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] VM Started (Lifecycle Event)
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3115f627-94e1-4988-b5d7-80211f87fc39 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.629s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:32:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMqIicVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:32:31 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:31 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:31 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ae974-2898-4ec7-8551-fd0c52709d30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:32:31 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b55020e-8579-41a0-a782-41b920b8d6b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa] added
Aug 17 10:32:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f51858-8015-4060-af9e-d299597749e2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb5a5a9-6848-4c09-8b24-1717527b71b9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMqIicVD {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMqIicVD" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[889b78d4-fc0e-4459-9141-1f2840d7098f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oMqIicVD'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdbd7dd-1578-41f6-84c0-61f4e86b3203]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1bf82c-49ef-4b84-8ae7-4e11724950c1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[915afa69-3263-475e-9182-0dec9b449cee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260]
Aug 17 10:32:31 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260] successful.
Aug 17 10:32:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[267af7c2-c6f2-409d-8a80-33b395c2d41e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d14eb-b4ba-4dee-9fe9-ae1522dcd273]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)
Aug 17 10:32:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:31 user nova-compute[73158]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)
Aug 17 10:32:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28129767-15c0-49e0-8f78-2461f4afaa9e]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMqIicVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:32:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26632633131303330', 'path': '/dev/sdf'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632633131303330', 'path': '/dev/sdf'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:32:32 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:32 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:32:32 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:32:32 user nova-compute[73158]:   <serial>d8537460-dcd4-4d7c-9724-2cfabecabefa</serial>
Aug 17 10:32:32 user nova-compute[73158]: </disk>
Aug 17 10:32:32 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] No VIF found with MAC fa:16:3e:e6:fa:e4, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:32:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8cb1b48d-d3aa-44ab-abaa-b2c2cb0fa34b tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.911s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:33 user nova-compute[73158]: INFO nova.compute.manager [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Detaching volume cb13300e-abd8-41bd-b59d-ddde78ebbcbf
Aug 17 10:32:33 user nova-compute[73158]: INFO nova.virt.block_device [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attempting to driver detach volume cb13300e-abd8-41bd-b59d-ddde78ebbcbf from mountpoint /dev/vdb
Aug 17 10:32:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Attempting to detach device vdb from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:32:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:32:33 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:33 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:32:33 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:32:33 user nova-compute[73158]:   <serial>cb13300e-abd8-41bd-b59d-ddde78ebbcbf</serial>
Aug 17 10:32:33 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:32:33 user nova-compute[73158]: </disk>
Aug 17 10:32:33 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:32:33 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully detached device vdb from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the persistent domain config.
Aug 17 10:32:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:32:33 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:32:33 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:33 user nova-compute[73158]:   <source dev="/dev/sde"/>
Aug 17 10:32:33 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:32:33 user nova-compute[73158]:   <serial>cb13300e-abd8-41bd-b59d-ddde78ebbcbf</serial>
Aug 17 10:32:33 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:32:33 user nova-compute[73158]: </disk>
Aug 17 10:32:33 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268354.05451, a3227506-f705-4059-aa51-0a2b38a57c30 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:32:34 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully detached device vdb from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the live domain config.
Aug 17 10:32:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FjleyAxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:32:34 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f4f98-49d3-411e-a934-2755750ccfbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af9853d-284f-4e88-b400-79292a092368]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)
Aug 17 10:32:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf (non-flash)
Aug 17 10:32:34 user nova-compute[73158]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)
Aug 17 10:32:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc6d25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf'): ({'sde'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Removing single pathed devices sde {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7360d1a4-4a89-4aac-88df-55f8abd4205f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eba5958-a44a-4e7d-a557-f6319d013473]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flushing IO for device /dev/sde {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[60161786-c2ee-4f23-a878-5df7c28fde5c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf136fd-4f05-4559-9db0-7b95e6c80864]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] SCSI volumes sde have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a96d43-e1a5-4ba2-baf2-89097c520541]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f442ac0-a15c-42bc-b643-5856ac3cd532]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260]
Aug 17 10:32:34 user nova-compute[73158]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf, portal: 172.16.0.220,3260] successful.
Aug 17 10:32:34 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb13300e-abd8-41bd-b59d-ddde78ebbcbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba08f64-74ac-4283-85d6-c29965cebe66]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== disconnect_volume: return (285ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8aecec12-bb2c-405f-a3d0-6aad76438196 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:32:35 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:36 user nova-compute[73158]: INFO nova.compute.manager [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Detaching volume d8537460-dcd4-4d7c-9724-2cfabecabefa
Aug 17 10:32:36 user nova-compute[73158]: INFO nova.virt.block_device [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Attempting to driver detach volume d8537460-dcd4-4d7c-9724-2cfabecabefa from mountpoint /dev/vdc
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Attempting to detach device vdc from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:32:36 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:36 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:32:36 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:32:36 user nova-compute[73158]:   <serial>d8537460-dcd4-4d7c-9724-2cfabecabefa</serial>
Aug 17 10:32:36 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 10:32:36 user nova-compute[73158]: </disk>
Aug 17 10:32:36 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:32:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully detached device vdc from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the persistent domain config.
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:32:36 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:32:36 user nova-compute[73158]:   <source dev="/dev/sdf"/>
Aug 17 10:32:36 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:32:36 user nova-compute[73158]:   <serial>d8537460-dcd4-4d7c-9724-2cfabecabefa</serial>
Aug 17 10:32:36 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 10:32:36 user nova-compute[73158]: </disk>
Aug 17 10:32:36 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268356.554729, a3227506-f705-4059-aa51-0a2b38a57c30 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:32:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully detached device vdc from instance a3227506-f705-4059-aa51-0a2b38a57c30 from the live domain config.
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMqIicVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:32:36 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc5746d-b178-4844-8205-db246e66ea92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25c01f-b302-43d2-9b53-c04a757afe57]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:36 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:36 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:36 user nova-compute[73158]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)
Aug 17 10:32:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:32:36 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:32:36 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:32:36 user nova-compute[73158]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa (non-flash)
Aug 17 10:32:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc7e0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa'): ({'sdf'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Removing single pathed devices sdf {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f75d0d-9ca3-4a4b-8663-f0bb4d7c537c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513bc58-f06e-43b3-8057-43377fa43375]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Flushing IO for device /dev/sdf {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c51ccc-17ed-42d1-9ed6-cac7488dddda]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa345b-ba16-414d-83a5-977e6b060086]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] SCSI volumes sdf have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[675d00bd-ccc0-4d14-ae06-3ca59a4070c4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a6785-3ab9-4732-aaa5-e4785256b39b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260]
Aug 17 10:32:36 user nova-compute[73158]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa, portal: 172.16.0.220,3260] successful.
Aug 17 10:32:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8537460-dcd4-4d7c-9724-2cfabecabefa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[faebd96b-2866-48b6-8584-eca7217ba4b5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] <== disconnect_volume: return (302ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'flavor' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:37 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:32:37 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:32:37 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7797MB free_disk=23.970882415771484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8c754700-3503-42f5-957e-6fd77069a75c tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.015s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 204904fe-4ce2-4aff-bd50-c4f79fab6899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 23cda7ce-352a-49e1-886a-bf300b522620 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance a3227506-f705-4059-aa51-0a2b38a57c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:38 user nova-compute[73158]: INFO nova.compute.manager [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Terminating instance
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-a85a031b-295b-4275-b1dc-af844a6f5edd req-c6c31ddd-1d32-4ba7-a26d-285166a5bb48 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-vif-unplugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a85a031b-295b-4275-b1dc-af844a6f5edd req-c6c31ddd-1d32-4ba7-a26d-285166a5bb48 service nova] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a85a031b-295b-4275-b1dc-af844a6f5edd req-c6c31ddd-1d32-4ba7-a26d-285166a5bb48 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a85a031b-295b-4275-b1dc-af844a6f5edd req-c6c31ddd-1d32-4ba7-a26d-285166a5bb48 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-a85a031b-295b-4275-b1dc-af844a6f5edd req-c6c31ddd-1d32-4ba7-a26d-285166a5bb48 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] No waiting events found dispatching network-vif-unplugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-a85a031b-295b-4275-b1dc-af844a6f5edd req-c6c31ddd-1d32-4ba7-a26d-285166a5bb48 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-vif-unplugged-283c4cda-4da6-47c7-ae06-00a45b74678c for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:32:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Instance destroyed successfully.
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lazy-loading 'resources' on Instance uuid a3227506-f705-4059-aa51-0a2b38a57c30 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214684663',display_name='tempest-AttachVolumeTestJSON-server-1214684663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214684663',id=37,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK2hHJeAVy7tw8djO3U7FbNNZ3tLU0M38XOvUmWMKQmpb3qw6wcaWqNvArWQduavOPJwbT3G6Wu6hW+4iSUEMm2JgG68iqiQFjTT1Nj6rFokjEMHrOFlZqwo8d4MHjlHg==',key_name='tempest-keypair-2111402704',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:30:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6ec620087724665b6218bb575bfcbef',ramdisk_id='',reservation_id='r-uk3t1r9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1679631742',owner_user_name='tempest-AttachVolumeTestJSON-1679631742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1230fe2ff59346c7a312ef772820cab1',uuid=a3227506-f705-4059-aa51-0a2b38a57c30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converting VIF {"id": "283c4cda-4da6-47c7-ae06-00a45b74678c", "address": "fa:16:3e:e6:fa:e4", "network": {"id": "9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783865900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ec620087724665b6218bb575bfcbef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4cda-4d", "ovs_interfaceid": "283c4cda-4da6-47c7-ae06-00a45b74678c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG os_vif [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap283c4cda-4d, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:32:39 user nova-compute[73158]: INFO os_vif [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fa:e4,bridge_name='br-int',has_traffic_filtering=True,id=283c4cda-4da6-47c7-ae06-00a45b74678c,network=Network(9ffae7ba-d2f7-4e6f-a9f7-cc3f3d287024),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4cda-4d')
Aug 17 10:32:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Deleting instance files /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30_del
Aug 17 10:32:39 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Deletion of /opt/stack/data/nova/instances/a3227506-f705-4059-aa51-0a2b38a57c30_del complete
Aug 17 10:32:39 user nova-compute[73158]: INFO nova.compute.manager [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 10:32:39 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:32:39 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:32:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-166d2e44-d600-44fb-b8ac-29000d495317 req-3cca033b-d6a7-49f4-8fd5-068d62792db6 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-166d2e44-d600-44fb-b8ac-29000d495317 req-3cca033b-d6a7-49f4-8fd5-068d62792db6 service nova] Acquiring lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-166d2e44-d600-44fb-b8ac-29000d495317 req-3cca033b-d6a7-49f4-8fd5-068d62792db6 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-166d2e44-d600-44fb-b8ac-29000d495317 req-3cca033b-d6a7-49f4-8fd5-068d62792db6 service nova] Lock "a3227506-f705-4059-aa51-0a2b38a57c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:40 user nova-compute[73158]: DEBUG nova.compute.manager [req-166d2e44-d600-44fb-b8ac-29000d495317 req-3cca033b-d6a7-49f4-8fd5-068d62792db6 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] No waiting events found dispatching network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:32:40 user nova-compute[73158]: WARNING nova.compute.manager [req-166d2e44-d600-44fb-b8ac-29000d495317 req-3cca033b-d6a7-49f4-8fd5-068d62792db6 service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received unexpected event network-vif-plugged-283c4cda-4da6-47c7-ae06-00a45b74678c for instance with vm_state active and task_state deleting.
Aug 17 10:32:41 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [{"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f8fbae4f-23df-44d8-99bc-992b84cf59ee" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:32:41 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Took 1.78 seconds to deallocate network for instance.
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:41 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Deleted allocations for instance a3227506-f705-4059-aa51-0a2b38a57c30
Aug 17 10:32:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-3c151069-9972-4ce3-ac29-50edd58cc541 tempest-AttachVolumeTestJSON-1679631742 tempest-AttachVolumeTestJSON-1679631742-project-member] Lock "a3227506-f705-4059-aa51-0a2b38a57c30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.056s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:32:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-14d8328e-e6a4-4549-bcc7-29a21fa24b71 req-b1ced765-78f1-4738-8780-3e123cae856f service nova] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Received event network-vif-deleted-283c4cda-4da6-47c7-ae06-00a45b74678c {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:32:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:32:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:32:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:54 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268359.3991256, a3227506-f705-4059-aa51-0a2b38a57c30 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:32:54 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] VM Stopped (Lifecycle Event)
Aug 17 10:32:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-b15f36d7-37db-4d55-a67b-c3bbeb460937 None None] [instance: a3227506-f705-4059-aa51-0a2b38a57c30] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:32:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:32:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:33:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:33:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:33:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:28 user nova-compute[73158]: INFO nova.compute.manager [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Terminating instance
Aug 17 10:33:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-a1b9368b-d2fd-4990-b481-baaa2aa2e3d1 req-3b77954f-3cc4-46d7-89e4-4079422a98aa service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a1b9368b-d2fd-4990-b481-baaa2aa2e3d1 req-3b77954f-3cc4-46d7-89e4-4079422a98aa service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a1b9368b-d2fd-4990-b481-baaa2aa2e3d1 req-3b77954f-3cc4-46d7-89e4-4079422a98aa service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a1b9368b-d2fd-4990-b481-baaa2aa2e3d1 req-3b77954f-3cc4-46d7-89e4-4079422a98aa service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-a1b9368b-d2fd-4990-b481-baaa2aa2e3d1 req-3b77954f-3cc4-46d7-89e4-4079422a98aa service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:33:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-a1b9368b-d2fd-4990-b481-baaa2aa2e3d1 req-3b77954f-3cc4-46d7-89e4-4079422a98aa service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-unplugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:33:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Instance destroyed successfully.
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'resources' on Instance uuid 204904fe-4ce2-4aff-bd50-c4f79fab6899 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:27:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127959669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127959669',id=33,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-mda99a1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:31:43Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=204904fe-4ce2-4aff-bd50-c4f79fab6899,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "c2d13c32-7396-494d-8548-94f9beea394a", "address": "fa:16:3e:0e:c7:27", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2d13c32-73", "ovs_interfaceid": "c2d13c32-7396-494d-8548-94f9beea394a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_vif [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2d13c32-73, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:29 user nova-compute[73158]: INFO os_vif [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c7:27,bridge_name='br-int',has_traffic_filtering=True,id=c2d13c32-7396-494d-8548-94f9beea394a,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2d13c32-73')
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtSrbwlN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:33:29 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6451dc67-4987-4b9e-9aed-3af1a0e7acb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe5cd62-ede8-4f86-a268-c4e3bcfcd1bd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:33:29 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:33:29 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:33:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:33:29 user nova-compute[73158]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 (non-flash)
Aug 17 10:33:29 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:33:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc3cfa3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[931ae89f-5988-4194-819b-92b066eb7f0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde414f7-fee3-4458-a0ec-b02f99b956ff]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d7ecb-c159-4ffc-921b-ad92f58a9068]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd6543d-ddd0-45af-9b7c-93008acf1cd1]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd380769b-ed34eea548199b1f', '/dev/disk/by-id/scsi-26564333465656135', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d380769b') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14afc9d-3d7d-4c0a-94f4-3f43d0edcfa9]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bfc3d0-b496-4fc5-98e8-b666cc4a5e3a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e52f2b-d2d8-4046-8517-b8e2d4d942cb]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260]
Aug 17 10:33:29 user nova-compute[73158]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838, portal: 172.16.0.220,3260] successful.
Aug 17 10:33:29 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4930fdb-0f26-43a2-8ba5-e70d91420838 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d370537-e056-4f3c-9b84-65d40213dbcd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== disconnect_volume: return (341ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:33:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Deleting instance files /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899_del
Aug 17 10:33:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Deletion of /opt/stack/data/nova/instances/204904fe-4ce2-4aff-bd50-c4f79fab6899_del complete
Aug 17 10:33:29 user nova-compute[73158]: INFO nova.compute.manager [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 17 10:33:29 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:33:29 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:33:30 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:33:30 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Took 0.79 seconds to deallocate network for instance.
Aug 17 10:33:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] Acquiring lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] No waiting events found dispatching network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:33:30 user nova-compute[73158]: WARNING nova.compute.manager [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received unexpected event network-vif-plugged-c2d13c32-7396-494d-8548-94f9beea394a for instance with vm_state active and task_state deleting.
Aug 17 10:33:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-5513e027-23c5-443e-b336-a08bd81f0ba8 req-f560d6f1-343e-4a0c-9e36-ba5f5d63cae9 service nova] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Received event network-vif-deleted-c2d13c32-7396-494d-8548-94f9beea394a {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:31 user nova-compute[73158]: INFO nova.compute.manager [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Took 0.97 seconds to detach 1 volumes for instance.
Aug 17 10:33:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:31 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:33:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:33:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:31 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Deleted allocations for instance 204904fe-4ce2-4aff-bd50-c4f79fab6899
Aug 17 10:33:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0b371da8-c5ca-4a86-b0df-8c8edf10dd2c tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "204904fe-4ce2-4aff-bd50-c4f79fab6899" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:33 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:34 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:36 user nova-compute[73158]: INFO nova.compute.manager [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Unshelving
Aug 17 10:33:36 user nova-compute[73158]: INFO nova.virt.block_device [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Booting with volume 4a0bb934-ad90-417b-9e79-77be45b0e544 at /dev/vdc
Aug 17 10:33:36 user nova-compute[73158]: DEBUG os_brick.utils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30b2773-7234-4578-b4eb-a5b7290275ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[986420c9-2885-452c-adf8-ad256d18ead4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6be482-d8ef-4cbf-b827-945a46f6288a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[764c1053-ca3c-4809-8976-6e4f58980689]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:33:37 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698d704-da49-4272-804e-1bd3cd40ab2c]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG os_brick.utils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating existing volume attachment record: 871e59c1-f8df-43c9-ad34-f35e807c3d81 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:33:37 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:33:39 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8131MB free_disk=23.986865997314453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 23cda7ce-352a-49e1-886a-bf300b522620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e40b0f21-6d72-42b6-8877-492c974834f4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:33:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Updating instance_info_cache with network_info: [{"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268409.1272182, 204904fe-4ce2-4aff-bd50-c4f79fab6899 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:33:44 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] VM Stopped (Lifecycle Event)
Aug 17 10:33:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a6ed359b-b239-4031-9d7a-b32b70088c4c None None] [instance: 204904fe-4ce2-4aff-bd50-c4f79fab6899] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:33:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:47 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'pci_requests' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:47 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'numa_topology' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:47 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:33:47 user nova-compute[73158]: INFO nova.compute.claims [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Claim successful on node user
Aug 17 10:33:48 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:33:48 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:33:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:48 user nova-compute[73158]: INFO nova.network.neutron [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating port c628c076-ee40-421e-99da-03c425aa1599 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-changed-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Refreshing instance network info cache due to event network-changed-c628c076-ee40-421e-99da-03c425aa1599. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:33:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Creating image(s)
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'trusted_certs' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Refreshing network info cache for port c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "84e480ce23b73ab5a85c56116cacd5e23866e97c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "84e480ce23b73ab5a85c56116cacd5e23866e97c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG nova.virt.images [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] 9874be58-995e-4824-aa3b-64ba048ed199 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.part /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updated VIF entry in instance network info cache for port c628c076-ee40-421e-99da-03c425aa1599. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:33:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.part /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.converted" returned: 0 in 0.258s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-424979c2-2192-4381-9275-3e609e3873c7 req-1e7adc5e-a887-435e-9741-15cbb51fb001 service nova] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "84e480ce23b73ab5a85c56116cacd5e23866e97c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.625s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "84e480ce23b73ab5a85c56116cacd5e23866e97c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "84e480ce23b73ab5a85c56116cacd5e23866e97c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c,backing_fmt=raw /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c,backing_fmt=raw /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk 1073741824" returned: 0 in 0.052s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "84e480ce23b73ab5a85c56116cacd5e23866e97c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'migration_context' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:51 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Rebasing disk image.
Aug 17 10:33:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.194s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc -F raw /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "05bfe591-9892-43f4-a850-a178a2937b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:33:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:53 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:33:53 user nova-compute[73158]: INFO nova.compute.claims [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Claim successful on node user
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc -F raw /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk" returned: 0 in 2.108s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Ensure instance console log exists: /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Start _get_guest_xml network_info=[{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6b2359c55fb34429ac57b9e39d4db55d',container_format='bare',created_at=2023-08-17T10:31:44Z,direct_url=<?>,disk_format='qcow2',id=9874be58-995e-4824-aa3b-64ba048ed199,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-662312586-shelved',owner='26e64443813742dca6185cfd559df272',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T10:31:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'attachment_id': '871e59c1-f8df-43c9-ad34-f35e807c3d81', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBKzeEps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e40b0f21-6d72-42b6-8877-492c974834f4', 'attached_at': '', 'detached_at': '', 'volume_id': '4a0bb934-ad90-417b-9e79-77be45b0e544', 'serial': '4a0bb934-ad90-417b-9e79-77be45b0e544'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:33:54 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:33:54 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6b2359c55fb34429ac57b9e39d4db55d',container_format='bare',created_at=2023-08-17T10:31:44Z,direct_url=<?>,disk_format='qcow2',id=9874be58-995e-4824-aa3b-64ba048ed199,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-662312586-shelved',owner='26e64443813742dca6185cfd559df272',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T10:31:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'vcpu_model' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBKzeEps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:33:54 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:33:54 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:33:54 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c168d253-d58f-4e0e-bee4-a607ff95c54a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:33:54 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c16492-0e63-4b43-abb7-df9e0d23b150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544] added
Aug 17 10:33:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[942d72e3-e71e-483c-96c6-992312392fd6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadc7cae-d482-498a-918c-52441e391696]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBKzeEps {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBKzeEps" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f907124-e461-4ddd-bc2c-6a1ad3c75d3f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rBKzeEps'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.policy [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '499f77486ae9486990357d021d0a78cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6ce46509014f69a037b59466497704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f0e2ee-a0ee-4a34-beb5-4fcb513df886]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f3440e-3a53-4400-8e9b-3ddd3d26fce0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:33:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Creating image(s)
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "/opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "/opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "/opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2cedb1-e23a-4345-80a9-050cfcb79cb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260]
Aug 17 10:33:54 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260] successful.
Aug 17 10:33:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.190s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a44f15-981c-4424-88f6-e72c7c6d2a54]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.274s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e55374-9b61-4184-9e52-a82a3d9c4140]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:33:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.557s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3344dd-f30a-4dec-81ff-0c156ef19609]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.199s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk 1073741824" returned: 0 in 0.117s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Successfully created port: 5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.229s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Cannot resize image /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lazy-loading 'migration_context' on Instance uuid 05bfe591-9892-43f4-a850-a178a2937b2f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBKzeEps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.595s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] <== connect_volume: return (1596ms) {'type': 'block', 'scsi_wwn': '23364646230316366', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364646230316366', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662312586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662312586',id=35,image_ref='9874be58-995e-4824-aa3b-64ba048ed199',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1462162459',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-teieknqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member',shelved_at='2023-08-17T10:31:48.287478',shelved_host='user',shelved_image_id='9874be58-995e-4824-aa3b-64ba048ed199'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:33:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=e40b0f21-6d72-42b6-8877-492c974834f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'pci_devices' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:33:55 user nova-compute[73158]:   <uuid>e40b0f21-6d72-42b6-8877-492c974834f4</uuid>
Aug 17 10:33:55 user nova-compute[73158]:   <name>instance-00000023</name>
Aug 17 10:33:55 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:33:55 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:33:55 user nova-compute[73158]:   <metadata>
Aug 17 10:33:55 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:33:55 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:33:55 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-662312586</nova:name>
Aug 17 10:33:55 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:33:54</nova:creationTime>
Aug 17 10:33:55 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:33:55 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:33:55 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:33:55 user nova-compute[73158]:       <nova:owner>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:user uuid="cbf2fd52d7184d43aa53bf0d9b2afeca">tempest-AttachVolumeShelveTestJSON-1136258329-project-member</nova:user>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:project uuid="26e64443813742dca6185cfd559df272">tempest-AttachVolumeShelveTestJSON-1136258329</nova:project>
Aug 17 10:33:55 user nova-compute[73158]:       </nova:owner>
Aug 17 10:33:55 user nova-compute[73158]:       <nova:root type="image" uuid="9874be58-995e-4824-aa3b-64ba048ed199"/>
Aug 17 10:33:55 user nova-compute[73158]:       <nova:ports>
Aug 17 10:33:55 user nova-compute[73158]:         <nova:port uuid="c628c076-ee40-421e-99da-03c425aa1599">
Aug 17 10:33:55 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:33:55 user nova-compute[73158]:         </nova:port>
Aug 17 10:33:55 user nova-compute[73158]:       </nova:ports>
Aug 17 10:33:55 user nova-compute[73158]:     </nova:instance>
Aug 17 10:33:55 user nova-compute[73158]:   </metadata>
Aug 17 10:33:55 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:33:55 user nova-compute[73158]:     <system>
Aug 17 10:33:55 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:33:55 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:33:55 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:33:55 user nova-compute[73158]:       <entry name="serial">e40b0f21-6d72-42b6-8877-492c974834f4</entry>
Aug 17 10:33:55 user nova-compute[73158]:       <entry name="uuid">e40b0f21-6d72-42b6-8877-492c974834f4</entry>
Aug 17 10:33:55 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:33:55 user nova-compute[73158]:     </system>
Aug 17 10:33:55 user nova-compute[73158]:   </sysinfo>
Aug 17 10:33:55 user nova-compute[73158]:   <os>
Aug 17 10:33:55 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:33:55 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:33:55 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:33:55 user nova-compute[73158]:   </os>
Aug 17 10:33:55 user nova-compute[73158]:   <features>
Aug 17 10:33:55 user nova-compute[73158]:     <acpi/>
Aug 17 10:33:55 user nova-compute[73158]:     <apic/>
Aug 17 10:33:55 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:33:55 user nova-compute[73158]:   </features>
Aug 17 10:33:55 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:33:55 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:33:55 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:33:55 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:33:55 user nova-compute[73158]:   </clock>
Aug 17 10:33:55 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:33:55 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:33:55 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:33:55 user nova-compute[73158]:   </cpu>
Aug 17 10:33:55 user nova-compute[73158]:   <devices>
Aug 17 10:33:55 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:33:55 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:33:55 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk"/>
Aug 17 10:33:55 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:33:55 user nova-compute[73158]:     </disk>
Aug 17 10:33:55 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:33:55 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:33:55 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:33:55 user nova-compute[73158]:       <target dev="vdc" bus="virtio"/>
Aug 17 10:33:55 user nova-compute[73158]:       <serial>4a0bb934-ad90-417b-9e79-77be45b0e544</serial>
Aug 17 10:33:55 user nova-compute[73158]:     </disk>
Aug 17 10:33:55 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:33:55 user nova-compute[73158]:       <mac address="fa:16:3e:40:12:f8"/>
Aug 17 10:33:55 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:33:55 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:33:55 user nova-compute[73158]:       <target dev="tapc628c076-ee"/>
Aug 17 10:33:55 user nova-compute[73158]:     </interface>
Aug 17 10:33:55 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:33:55 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/console.log" append="off"/>
Aug 17 10:33:55 user nova-compute[73158]:     </serial>
Aug 17 10:33:55 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:33:55 user nova-compute[73158]:     <video>
Aug 17 10:33:55 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:33:55 user nova-compute[73158]:     </video>
Aug 17 10:33:55 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:33:55 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:33:55 user nova-compute[73158]:     </rng>
Aug 17 10:33:55 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:33:55 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:33:55 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:33:55 user nova-compute[73158]:     </memballoon>
Aug 17 10:33:55 user nova-compute[73158]:   </devices>
Aug 17 10:33:55 user nova-compute[73158]: </domain>
Aug 17 10:33:55 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662312586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662312586',id=35,image_ref='9874be58-995e-4824-aa3b-64ba048ed199',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1462162459',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-teieknqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member',shelved_at='2023-08-17T10:31:48.287478',shelved_host='user',shelved_image_id='9874be58-995e-4824-aa3b-64ba048ed199'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:33:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=e40b0f21-6d72-42b6-8877-492c974834f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG os_vif [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc628c076-ee, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc628c076-ee, col_values=(('external_ids', {'iface-id': 'c628c076-ee40-421e-99da-03c425aa1599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:12:f8', 'vm-uuid': 'e40b0f21-6d72-42b6-8877-492c974834f4'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:55 user nova-compute[73158]: INFO os_vif [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee')
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:33:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No VIF found with MAC fa:16:3e:40:12:f8, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Successfully updated port: 5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "refresh_cache-05bfe591-9892-43f4-a850-a178a2937b2f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquired lock "refresh_cache-05bfe591-9892-43f4-a850-a178a2937b2f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-changed-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Refreshing instance network info cache due to event network-changed-5c64806a-1a21-4345-b247-59f4d8b66aac. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] Acquiring lock "refresh_cache-05bfe591-9892-43f4-a850-a178a2937b2f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Updating instance_info_cache with network_info: [{"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Releasing lock "refresh_cache-05bfe591-9892-43f4-a850-a178a2937b2f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Instance network_info: |[{"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] Acquired lock "refresh_cache-05bfe591-9892-43f4-a850-a178a2937b2f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Refreshing network info cache for port 5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Start _get_guest_xml network_info=[{"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:33:56 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:33:56 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:33:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-506131107',display_name='tempest-ServersNegativeTestJSON-server-506131107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-506131107',id=39,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6ce46509014f69a037b59466497704',ramdisk_id='',reservation_id='r-9f0b6bsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2112722000',owner_user_name='tempest-ServersNegativeTestJSON-2112722000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:33:54Z,user_data=None,user_id='499f77486ae9486990357d021d0a78cf',uuid=05bfe591-9892-43f4-a850-a178a2937b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converting VIF {"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lazy-loading 'pci_devices' on Instance uuid 05bfe591-9892-43f4-a850-a178a2937b2f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:33:56 user nova-compute[73158]:   <uuid>05bfe591-9892-43f4-a850-a178a2937b2f</uuid>
Aug 17 10:33:56 user nova-compute[73158]:   <name>instance-00000027</name>
Aug 17 10:33:56 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:33:56 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:33:56 user nova-compute[73158]:   <metadata>
Aug 17 10:33:56 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:33:56 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:33:56 user nova-compute[73158]:       <nova:name>tempest-ServersNegativeTestJSON-server-506131107</nova:name>
Aug 17 10:33:56 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:33:56</nova:creationTime>
Aug 17 10:33:56 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:33:56 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:33:56 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:33:56 user nova-compute[73158]:       <nova:owner>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:user uuid="499f77486ae9486990357d021d0a78cf">tempest-ServersNegativeTestJSON-2112722000-project-member</nova:user>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:project uuid="4f6ce46509014f69a037b59466497704">tempest-ServersNegativeTestJSON-2112722000</nova:project>
Aug 17 10:33:56 user nova-compute[73158]:       </nova:owner>
Aug 17 10:33:56 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:33:56 user nova-compute[73158]:       <nova:ports>
Aug 17 10:33:56 user nova-compute[73158]:         <nova:port uuid="5c64806a-1a21-4345-b247-59f4d8b66aac">
Aug 17 10:33:56 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:33:56 user nova-compute[73158]:         </nova:port>
Aug 17 10:33:56 user nova-compute[73158]:       </nova:ports>
Aug 17 10:33:56 user nova-compute[73158]:     </nova:instance>
Aug 17 10:33:56 user nova-compute[73158]:   </metadata>
Aug 17 10:33:56 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:33:56 user nova-compute[73158]:     <system>
Aug 17 10:33:56 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:33:56 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:33:56 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:33:56 user nova-compute[73158]:       <entry name="serial">05bfe591-9892-43f4-a850-a178a2937b2f</entry>
Aug 17 10:33:56 user nova-compute[73158]:       <entry name="uuid">05bfe591-9892-43f4-a850-a178a2937b2f</entry>
Aug 17 10:33:56 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:33:56 user nova-compute[73158]:     </system>
Aug 17 10:33:56 user nova-compute[73158]:   </sysinfo>
Aug 17 10:33:56 user nova-compute[73158]:   <os>
Aug 17 10:33:56 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:33:56 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:33:56 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:33:56 user nova-compute[73158]:   </os>
Aug 17 10:33:56 user nova-compute[73158]:   <features>
Aug 17 10:33:56 user nova-compute[73158]:     <acpi/>
Aug 17 10:33:56 user nova-compute[73158]:     <apic/>
Aug 17 10:33:56 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:33:56 user nova-compute[73158]:   </features>
Aug 17 10:33:56 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:33:56 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:33:56 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:33:56 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:33:56 user nova-compute[73158]:   </clock>
Aug 17 10:33:56 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:33:56 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:33:56 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:33:56 user nova-compute[73158]:   </cpu>
Aug 17 10:33:56 user nova-compute[73158]:   <devices>
Aug 17 10:33:56 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:33:56 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:33:56 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk"/>
Aug 17 10:33:56 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:33:56 user nova-compute[73158]:     </disk>
Aug 17 10:33:56 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:33:56 user nova-compute[73158]:       <mac address="fa:16:3e:81:56:09"/>
Aug 17 10:33:56 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:33:56 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:33:56 user nova-compute[73158]:       <target dev="tap5c64806a-1a"/>
Aug 17 10:33:56 user nova-compute[73158]:     </interface>
Aug 17 10:33:56 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:33:56 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/console.log" append="off"/>
Aug 17 10:33:56 user nova-compute[73158]:     </serial>
Aug 17 10:33:56 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:33:56 user nova-compute[73158]:     <video>
Aug 17 10:33:56 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:33:56 user nova-compute[73158]:     </video>
Aug 17 10:33:56 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:33:56 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:33:56 user nova-compute[73158]:     </rng>
Aug 17 10:33:56 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:33:56 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:33:56 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:33:56 user nova-compute[73158]:     </memballoon>
Aug 17 10:33:56 user nova-compute[73158]:   </devices>
Aug 17 10:33:56 user nova-compute[73158]: </domain>
Aug 17 10:33:56 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:33:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-506131107',display_name='tempest-ServersNegativeTestJSON-server-506131107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-506131107',id=39,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6ce46509014f69a037b59466497704',ramdisk_id='',reservation_id='r-9f0b6bsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2112722000',owner_user_name='tempest-ServersNegativeTestJSON-2112722000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:33:54Z,user_data=None,user_id='499f77486ae9486990357d021d0a78cf',uuid=05bfe591-9892-43f4-a850-a178a2937b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converting VIF {"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG os_vif [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c64806a-1a, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c64806a-1a, col_values=(('external_ids', {'iface-id': '5c64806a-1a21-4345-b247-59f4d8b66aac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:56:09', 'vm-uuid': '05bfe591-9892-43f4-a850-a178a2937b2f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:56 user nova-compute[73158]: INFO os_vif [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a')
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] No VIF found with MAC fa:16:3e:81:56:09, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Updated VIF entry in instance network info cache for port 5c64806a-1a21-4345-b247-59f4d8b66aac. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG nova.network.neutron [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Updating instance_info_cache with network_info: [{"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:33:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e5919b67-489f-4157-b441-aef26878ab55 req-d0d870cb-5ac7-4b69-a7d0-ebc7e80a8583 service nova] Releasing lock "refresh_cache-05bfe591-9892-43f4-a850-a178a2937b2f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:33:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:33:58 user nova-compute[73158]: WARNING nova.compute.manager [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 10:33:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG nova.compute.manager [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:33:58 user nova-compute[73158]: WARNING nova.compute.manager [req-186354d0-f965-4854-a63e-301df4aeefd2 req-2e2fbddf-a6f4-40ad-a186-09cc6a7cdf83 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:33:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] No waiting events found dispatching network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:34:00 user nova-compute[73158]: WARNING nova.compute.manager [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received unexpected event network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac for instance with vm_state building and task_state spawning.
Aug 17 10:34:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] No waiting events found dispatching network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:34:00 user nova-compute[73158]: WARNING nova.compute.manager [req-c19bb56d-d90a-49c5-9f1e-f102128ded07 req-ce42791e-8695-4221-8c7c-1a7e8b12d0ac service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received unexpected event network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac for instance with vm_state building and task_state spawning.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268441.1822047, e40b0f21-6d72-42b6-8877-492c974834f4 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] VM Resumed (Lifecycle Event)
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance spawned successfully.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Instance spawned successfully.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268441.1854422, e40b0f21-6d72-42b6-8877-492c974834f4 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] VM Started (Lifecycle Event)
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268441.193303, 05bfe591-9892-43f4-a850-a178a2937b2f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] VM Resumed (Lifecycle Event)
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Took 6.88 seconds to spawn the instance on the hypervisor.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268441.19504, 05bfe591-9892-43f4-a850-a178a2937b2f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] VM Started (Lifecycle Event)
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:34:01 user nova-compute[73158]: INFO nova.compute.manager [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Took 7.66 seconds to build instance.
Aug 17 10:34:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5a355d57-f1f5-42dd-be0f-787a7d11be24 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "05bfe591-9892-43f4-a850-a178a2937b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.780s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef24f10e-715c-40e3-accc-e5f5f0c45931 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.844s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing instance network info cache due to event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:34:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:34:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:34:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updated VIF entry in instance network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c06bdbb2-5248-4c02-9d42-c7d8b43668af req-b4e84a40-92e7-42d0-8f05-57fcd52e73e2 service nova] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:07 user nova-compute[73158]: INFO nova.compute.manager [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Detaching volume af601589-c1d6-4075-a923-40505f0ce1b3
Aug 17 10:34:07 user nova-compute[73158]: INFO nova.virt.block_device [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Attempting to driver detach volume af601589-c1d6-4075-a923-40505f0ce1b3 from mountpoint /dev/vdb
Aug 17 10:34:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Attempting to detach device vdb from instance 23cda7ce-352a-49e1-886a-bf300b522620 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:34:07 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:34:07 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:34:07 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:34:07 user nova-compute[73158]:   <serial>af601589-c1d6-4075-a923-40505f0ce1b3</serial>
Aug 17 10:34:07 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:34:07 user nova-compute[73158]: </disk>
Aug 17 10:34:07 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:34:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully detached device vdb from instance 23cda7ce-352a-49e1-886a-bf300b522620 from the persistent domain config.
Aug 17 10:34:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23cda7ce-352a-49e1-886a-bf300b522620 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:34:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:34:07 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:34:07 user nova-compute[73158]:   <source dev="/dev/sdd"/>
Aug 17 10:34:07 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:34:07 user nova-compute[73158]:   <serial>af601589-c1d6-4075-a923-40505f0ce1b3</serial>
Aug 17 10:34:07 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:34:07 user nova-compute[73158]: </disk>
Aug 17 10:34:07 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268448.4364767, 23cda7ce-352a-49e1-886a-bf300b522620 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:34:08 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully detached device vdb from instance 23cda7ce-352a-49e1-886a-bf300b522620 from the live domain config.
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wnCYhycr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:34:08 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132a322-b9ad-4052-b84f-f78a3f5ddbb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3a330b-e00e-4cd8-818c-2dff249f40cf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:34:08 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:34:08 user nova-compute[73158]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:34:08 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:34:08 user nova-compute[73158]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 (non-flash)
Aug 17 10:34:08 user nova-compute[73158]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:34:08 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc4274b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3'): ({'sdd'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Removing single pathed devices sdd {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a9f770-9e5c-473c-a233-1c75fdeb3ff9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac2003d-028d-4d4e-bd42-3abbbb44eb2b]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Flushing IO for device /dev/sdd {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e1b7c4-e64c-498f-9c7a-a05d89666ac7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52a5a0-c1fa-4a2b-a17a-86fb47cdf018]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] SCSI volumes sdd have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd347c6-7f35-4344-8386-d8e8ce41f48d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae7a85a-be04-48f7-b156-e36a18c44e54]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260]
Aug 17 10:34:08 user nova-compute[73158]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3, portal: 172.16.0.220,3260] successful.
Aug 17 10:34:08 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing instance network info cache due to event network-changed-f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] Acquiring lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] Acquired lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Refreshing network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af601589-c1d6-4075-a923-40505f0ce1b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1120c235-e365-4ba1-956c-d79ff37dd41b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] <== disconnect_volume: return (303ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:34:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:34:09 user nova-compute[73158]: DEBUG nova.network.neutron [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updated VIF entry in instance network info cache for port f101e01b-d14b-4c39-8bfa-a0d4706cfee7. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:34:09 user nova-compute[73158]: DEBUG nova.network.neutron [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [{"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:34:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7b12dc6c-1f1c-4864-be35-b10243e21c93 req-872bb275-4b1e-4cb1-a599-7e81858ecb8c service nova] Releasing lock "refresh_cache-23cda7ce-352a-49e1-886a-bf300b522620" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:34:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'flavor' on Instance uuid 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:34:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c783d174-76a7-4be5-8544-18b4d37583ec tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:19 user nova-compute[73158]: INFO nova.compute.manager [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Terminating instance
Aug 17 10:34:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-9853e363-60ca-4ce1-b0ee-a14fe2771975 req-f889fb7c-22b2-4f4e-afc3-20cdd16658fc service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-vif-unplugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9853e363-60ca-4ce1-b0ee-a14fe2771975 req-f889fb7c-22b2-4f4e-afc3-20cdd16658fc service nova] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9853e363-60ca-4ce1-b0ee-a14fe2771975 req-f889fb7c-22b2-4f4e-afc3-20cdd16658fc service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9853e363-60ca-4ce1-b0ee-a14fe2771975 req-f889fb7c-22b2-4f4e-afc3-20cdd16658fc service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-9853e363-60ca-4ce1-b0ee-a14fe2771975 req-f889fb7c-22b2-4f4e-afc3-20cdd16658fc service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] No waiting events found dispatching network-vif-unplugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:34:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-9853e363-60ca-4ce1-b0ee-a14fe2771975 req-f889fb7c-22b2-4f4e-afc3-20cdd16658fc service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-vif-unplugged-52793cae-8d75-47b1-9299-e04e50c58905 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:34:20 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Instance destroyed successfully.
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.objects.instance [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'resources' on Instance uuid f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-202081318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-202081318',id=31,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:25:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-017d2ftj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:26:52Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "52793cae-8d75-47b1-9299-e04e50c58905", "address": "fa:16:3e:32:14:e2", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52793cae-8d", "ovs_interfaceid": "52793cae-8d75-47b1-9299-e04e50c58905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG os_vif [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52793cae-8d, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:20 user nova-compute[73158]: INFO os_vif [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:14:e2,bridge_name='br-int',has_traffic_filtering=True,id=52793cae-8d75-47b1-9299-e04e50c58905,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52793cae-8d')
Aug 17 10:34:20 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Deleting instance files /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b_del
Aug 17 10:34:20 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Deletion of /opt/stack/data/nova/instances/f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b_del complete
Aug 17 10:34:20 user nova-compute[73158]: INFO nova.compute.manager [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 10:34:20 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:34:20 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Took 0.45 seconds to deallocate network for instance.
Aug 17 10:34:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:21 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Deleted allocations for instance f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b
Aug 17 10:34:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dae1402b-cadc-4b07-b22f-f283273f21f3 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] Acquiring lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] Lock "f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] No waiting events found dispatching network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:34:21 user nova-compute[73158]: WARNING nova.compute.manager [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received unexpected event network-vif-plugged-52793cae-8d75-47b1-9299-e04e50c58905 for instance with vm_state deleted and task_state None.
Aug 17 10:34:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-12dd4f1c-796d-4937-9f88-9ce7465d85cf req-c0c3c630-334e-4b30-bb58-089efc6b1c4c service nova] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Received event network-vif-deleted-52793cae-8d75-47b1-9299-e04e50c58905 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:34:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:35 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268460.009278, f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:34:35 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] VM Stopped (Lifecycle Event)
Aug 17 10:34:35 user nova-compute[73158]: DEBUG nova.compute.manager [None req-6d3bb6d3-fea3-4f0f-8b58-9874d38d041c None None] [instance: f6e6c4d5-f1ca-49c5-a081-d0dcee8d3a2b] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:34:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:34:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:34:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:34:42 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:34:42 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=7976MB free_disk=24.046527862548828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 23cda7ce-352a-49e1-886a-bf300b522620 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e40b0f21-6d72-42b6-8877-492c974834f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 05bfe591-9892-43f4-a850-a178a2937b2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:34:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:34:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:34:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:34:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:34:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:34:45 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [{"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:34:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:34:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-e40b0f21-6d72-42b6-8877-492c974834f4" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:34:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:34:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:34:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:34:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:34:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:04 user nova-compute[73158]: INFO nova.compute.manager [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Terminating instance
Aug 17 10:35:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-530a8c54-1283-402d-8fef-d865bd143eae req-41ffe39d-eddd-4e3a-ae74-b629f03d5fb4 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-unplugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-530a8c54-1283-402d-8fef-d865bd143eae req-41ffe39d-eddd-4e3a-ae74-b629f03d5fb4 service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-530a8c54-1283-402d-8fef-d865bd143eae req-41ffe39d-eddd-4e3a-ae74-b629f03d5fb4 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-530a8c54-1283-402d-8fef-d865bd143eae req-41ffe39d-eddd-4e3a-ae74-b629f03d5fb4 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-530a8c54-1283-402d-8fef-d865bd143eae req-41ffe39d-eddd-4e3a-ae74-b629f03d5fb4 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-unplugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-530a8c54-1283-402d-8fef-d865bd143eae req-41ffe39d-eddd-4e3a-ae74-b629f03d5fb4 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-unplugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Instance destroyed successfully.
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lazy-loading 'resources' on Instance uuid 23cda7ce-352a-49e1-886a-bf300b522620 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-83248482',display_name='tempest-TestMinimumBasicScenario-server-83248482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-83248482',id=36,image_ref='69899660-4101-481e-9de1-433de5634b21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaEQ4dJL+lcHNC79J2RKdWn4AN8VjHqqmv+VK2iJMSpRatK5iMm3fICyv3DSdk337kzQehcQ0pBNmBdTVLPtBv94150GktxhNhRTi1Rr6CudKpMsQ6xygQGNKvsmhz2Lw==',key_name='tempest-TestMinimumBasicScenario-557568035',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beeb69e4c9da4d2d9403e97e35033f1a',ramdisk_id='',reservation_id='r-6scwi4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69899660-4101-481e-9de1-433de5634b21',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1702191441',owner_user_name='tempest-TestMinimumBasicScenario-1702191441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:32:22Z,user_data=None,user_id='b9e11c73731047a6990c618c2f7fe6a2',uuid=23cda7ce-352a-49e1-886a-bf300b522620,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converting VIF {"id": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "address": "fa:16:3e:b2:4c:e6", "network": {"id": "a75c9ea1-8da9-4c45-a0e2-e6b206725108", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126750806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb69e4c9da4d2d9403e97e35033f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf101e01b-d1", "ovs_interfaceid": "f101e01b-d14b-4c39-8bfa-a0d4706cfee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG os_vif [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf101e01b-d1, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:05 user nova-compute[73158]: INFO os_vif [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:e6,bridge_name='br-int',has_traffic_filtering=True,id=f101e01b-d14b-4c39-8bfa-a0d4706cfee7,network=Network(a75c9ea1-8da9-4c45-a0e2-e6b206725108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf101e01b-d1')
Aug 17 10:35:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Deleting instance files /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620_del
Aug 17 10:35:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Deletion of /opt/stack/data/nova/instances/23cda7ce-352a-49e1-886a-bf300b522620_del complete
Aug 17 10:35:05 user nova-compute[73158]: INFO nova.compute.manager [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 17 10:35:05 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:35:05 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:35:06 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:35:06 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Took 0.77 seconds to deallocate network for instance.
Aug 17 10:35:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-a0789258-12b5-4e25-8e8c-09d6966aae8d req-ecd16219-8d9b-4a5b-ba1b-d270315c65a7 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-deleted-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:06 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:35:06 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:35:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:06 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Deleted allocations for instance 23cda7ce-352a-49e1-886a-bf300b522620
Aug 17 10:35:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-847ad6f4-7093-46c8-b27e-14e053655c63 tempest-TestMinimumBasicScenario-1702191441 tempest-TestMinimumBasicScenario-1702191441-project-member] Lock "23cda7ce-352a-49e1-886a-bf300b522620" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-119538ef-2263-46b4-9f80-34df00918d2e req-00380830-5bbd-43a9-b90f-d87c48361f78 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-119538ef-2263-46b4-9f80-34df00918d2e req-00380830-5bbd-43a9-b90f-d87c48361f78 service nova] Acquiring lock "23cda7ce-352a-49e1-886a-bf300b522620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-119538ef-2263-46b4-9f80-34df00918d2e req-00380830-5bbd-43a9-b90f-d87c48361f78 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-119538ef-2263-46b4-9f80-34df00918d2e req-00380830-5bbd-43a9-b90f-d87c48361f78 service nova] Lock "23cda7ce-352a-49e1-886a-bf300b522620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-119538ef-2263-46b4-9f80-34df00918d2e req-00380830-5bbd-43a9-b90f-d87c48361f78 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] No waiting events found dispatching network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:35:07 user nova-compute[73158]: WARNING nova.compute.manager [req-119538ef-2263-46b4-9f80-34df00918d2e req-00380830-5bbd-43a9-b90f-d87c48361f78 service nova] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Received unexpected event network-vif-plugged-f101e01b-d14b-4c39-8bfa-a0d4706cfee7 for instance with vm_state deleted and task_state None.
Aug 17 10:35:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:09 user nova-compute[73158]: INFO nova.compute.manager [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Terminating instance
Aug 17 10:35:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:35:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-1fea581d-1b43-4944-ba8b-f37b6ff6fe67 req-e8f09e4a-eef8-4876-80fb-eeff6095aaa7 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1fea581d-1b43-4944-ba8b-f37b6ff6fe67 req-e8f09e4a-eef8-4876-80fb-eeff6095aaa7 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1fea581d-1b43-4944-ba8b-f37b6ff6fe67 req-e8f09e4a-eef8-4876-80fb-eeff6095aaa7 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1fea581d-1b43-4944-ba8b-f37b6ff6fe67 req-e8f09e4a-eef8-4876-80fb-eeff6095aaa7 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-1fea581d-1b43-4944-ba8b-f37b6ff6fe67 req-e8f09e4a-eef8-4876-80fb-eeff6095aaa7 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-1fea581d-1b43-4944-ba8b-f37b6ff6fe67 req-e8f09e4a-eef8-4876-80fb-eeff6095aaa7 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-unplugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Instance destroyed successfully.
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.objects.instance [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'resources' on Instance uuid f8fbae4f-23df-44d8-99bc-992b84cf59ee {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250266478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250266478',id=24,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-672w306k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:23:09Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=f8fbae4f-23df-44d8-99bc-992b84cf59ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "a069bad2-e308-400e-9b53-d48099e21259", "address": "fa:16:3e:c3:21:c9", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa069bad2-e3", "ovs_interfaceid": "a069bad2-e308-400e-9b53-d48099e21259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_vif [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa069bad2-e3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:10 user nova-compute[73158]: INFO os_vif [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:21:c9,bridge_name='br-int',has_traffic_filtering=True,id=a069bad2-e308-400e-9b53-d48099e21259,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa069bad2-e3')
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetGArSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:35:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0030530-7fb5-473f-bc94-da778dc3cf08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[450f940a-233a-4af9-875a-43af23f2d8ae]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:35:10 user nova-compute[73158]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:35:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 (non-flash)
Aug 17 10:35:10 user nova-compute[73158]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:35:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c773250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4a6fe-57e5-4bc8-8c4f-112360f60f6b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[03096aa4-4ef9-4520-aec3-f55de470757e]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e512c-701d-4472-b8cc-af16fe6b080d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f08fcd-2086-4d0f-9d9f-d2b7de9be6be]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844a250-5e9e-4e8b-805a-df00c8cb0f3f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1eeaf-ca89-4e16-a271-fed3de5f3cd4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260]
Aug 17 10:35:10 user nova-compute[73158]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870, portal: 172.16.0.220,3260] successful.
Aug 17 10:35:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21acdb4d-0337-4efe-8449-4d9c1cb82870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbb1f40-f1ff-4346-bbf4-eed212a22b65]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] <== disconnect_volume: return (297ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:35:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:35:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Deleting instance files /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee_del
Aug 17 10:35:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Deletion of /opt/stack/data/nova/instances/f8fbae4f-23df-44d8-99bc-992b84cf59ee_del complete
Aug 17 10:35:11 user nova-compute[73158]: INFO nova.compute.manager [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 17 10:35:11 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:35:11 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:35:11 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:35:11 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:35:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7a8f771-cc19-47b3-92d2-7e9ec0f8972b req-7b4a47d4-fff9-497a-b174-f7f2c264f9e8 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-deleted-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:11 user nova-compute[73158]: INFO nova.compute.manager [req-f7a8f771-cc19-47b3-92d2-7e9ec0f8972b req-7b4a47d4-fff9-497a-b174-f7f2c264f9e8 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Neutron deleted interface a069bad2-e308-400e-9b53-d48099e21259; detaching it from the instance and deleting it from the info cache
Aug 17 10:35:11 user nova-compute[73158]: DEBUG nova.network.neutron [req-f7a8f771-cc19-47b3-92d2-7e9ec0f8972b req-7b4a47d4-fff9-497a-b174-f7f2c264f9e8 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:35:11 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Took 0.54 seconds to deallocate network for instance.
Aug 17 10:35:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7a8f771-cc19-47b3-92d2-7e9ec0f8972b req-7b4a47d4-fff9-497a-b174-f7f2c264f9e8 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Detach interface failed, port_id=a069bad2-e308-400e-9b53-d48099e21259, reason: Instance f8fbae4f-23df-44d8-99bc-992b84cf59ee could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:35:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-28f373a4-58a7-43d8-9b9e-2928af0645a9 req-d5488da4-2a8e-40f7-9413-9e9d84c13472 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-28f373a4-58a7-43d8-9b9e-2928af0645a9 req-d5488da4-2a8e-40f7-9413-9e9d84c13472 service nova] Acquiring lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-28f373a4-58a7-43d8-9b9e-2928af0645a9 req-d5488da4-2a8e-40f7-9413-9e9d84c13472 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-28f373a4-58a7-43d8-9b9e-2928af0645a9 req-d5488da4-2a8e-40f7-9413-9e9d84c13472 service nova] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-28f373a4-58a7-43d8-9b9e-2928af0645a9 req-d5488da4-2a8e-40f7-9413-9e9d84c13472 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] No waiting events found dispatching network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:35:12 user nova-compute[73158]: WARNING nova.compute.manager [req-28f373a4-58a7-43d8-9b9e-2928af0645a9 req-d5488da4-2a8e-40f7-9413-9e9d84c13472 service nova] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Received unexpected event network-vif-plugged-a069bad2-e308-400e-9b53-d48099e21259 for instance with vm_state active and task_state deleting.
Aug 17 10:35:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:17 user nova-compute[73158]: INFO nova.compute.manager [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Took 5.78 seconds to detach 1 volumes for instance.
Aug 17 10:35:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:17 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:35:17 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:35:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:17 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Deleted allocations for instance f8fbae4f-23df-44d8-99bc-992b84cf59ee
Aug 17 10:35:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-274de32d-f0d3-44f7-88a6-1c9dd560256e tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "f8fbae4f-23df-44d8-99bc-992b84cf59ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.961s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:20 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268505.550477, 23cda7ce-352a-49e1-886a-bf300b522620 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:35:20 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] VM Stopped (Lifecycle Event)
Aug 17 10:35:20 user nova-compute[73158]: DEBUG nova.compute.manager [None req-05c1bc54-437b-41c1-84db-fca834820c95 None None] [instance: 23cda7ce-352a-49e1-886a-bf300b522620] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:35:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:25 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268510.6302598, f8fbae4f-23df-44d8-99bc-992b84cf59ee => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:35:25 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] VM Stopped (Lifecycle Event)
Aug 17 10:35:25 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5f41bb0e-ae39-4709-8c7b-7e97bd2b53d3 None None] [instance: f8fbae4f-23df-44d8-99bc-992b84cf59ee] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:35:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:26 user nova-compute[73158]: INFO nova.compute.manager [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Detaching volume 4a0bb934-ad90-417b-9e79-77be45b0e544
Aug 17 10:35:26 user nova-compute[73158]: INFO nova.virt.block_device [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Attempting to driver detach volume 4a0bb934-ad90-417b-9e79-77be45b0e544 from mountpoint /dev/vdc
Aug 17 10:35:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Attempting to detach device vdc from instance e40b0f21-6d72-42b6-8877-492c974834f4 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:35:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:35:26 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:35:26 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:35:26 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:35:26 user nova-compute[73158]:   <serial>4a0bb934-ad90-417b-9e79-77be45b0e544</serial>
Aug 17 10:35:26 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:35:26 user nova-compute[73158]: </disk>
Aug 17 10:35:26 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:35:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully detached device vdc from instance e40b0f21-6d72-42b6-8877-492c974834f4 from the persistent domain config.
Aug 17 10:35:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e40b0f21-6d72-42b6-8877-492c974834f4 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:35:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:35:26 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:35:26 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:35:26 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:35:26 user nova-compute[73158]:   <serial>4a0bb934-ad90-417b-9e79-77be45b0e544</serial>
Aug 17 10:35:26 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 10:35:26 user nova-compute[73158]: </disk>
Aug 17 10:35:26 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268527.5572426, e40b0f21-6d72-42b6-8877-492c974834f4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:35:27 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully detached device vdc from instance e40b0f21-6d72-42b6-8877-492c974834f4 from the live domain config.
Aug 17 10:35:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBKzeEps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:35:27 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b14c210-0db1-4f5d-a319-57d40b5033b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[114aa177-cebc-43ea-b39e-b881c6029fc9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:35:27 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 (non-flash)
Aug 17 10:35:27 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c773010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd46b889-6396-4c08-883e-15d2851abf66]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66c166d-8146-47fc-8f05-ac070f2967b5]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e437e-0a70-4c30-bd70-a96bc6d82917]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[29009f72-97c6-4ed3-831b-802daa98a0c3]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[908ef00f-6dca-4f94-87c8-7369fb74839c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c68e7-49e3-492a-8b1c-7df59e5e0d49]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260]
Aug 17 10:35:27 user nova-compute[73158]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544, portal: 172.16.0.220,3260] successful.
Aug 17 10:35:27 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0bb934-ad90-417b-9e79-77be45b0e544 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c491a2-a60f-488f-a42b-784696044bb8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] <== disconnect_volume: return (281ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:35:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:35:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'flavor' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:35:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1a342527-e8cc-4caa-a3fb-dd597eeb7554 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:35:42 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:35:42 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8259MB free_disk=24.071189880371094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 300a9c6a-ed23-494d-8f26-9b5b333273f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance e40b0f21-6d72-42b6-8877-492c974834f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 05bfe591-9892-43f4-a850-a178a2937b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:35:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "05bfe591-9892-43f4-a850-a178a2937b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:43 user nova-compute[73158]: INFO nova.compute.manager [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Terminating instance
Aug 17 10:35:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-e059f655-61de-403c-9670-51cdcc815b0a req-2489b2cb-bcc5-45f6-bda7-bbf4b9a10a5b service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-vif-unplugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e059f655-61de-403c-9670-51cdcc815b0a req-2489b2cb-bcc5-45f6-bda7-bbf4b9a10a5b service nova] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e059f655-61de-403c-9670-51cdcc815b0a req-2489b2cb-bcc5-45f6-bda7-bbf4b9a10a5b service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e059f655-61de-403c-9670-51cdcc815b0a req-2489b2cb-bcc5-45f6-bda7-bbf4b9a10a5b service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-e059f655-61de-403c-9670-51cdcc815b0a req-2489b2cb-bcc5-45f6-bda7-bbf4b9a10a5b service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] No waiting events found dispatching network-vif-unplugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:35:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-e059f655-61de-403c-9670-51cdcc815b0a req-2489b2cb-bcc5-45f6-bda7-bbf4b9a10a5b service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-vif-unplugged-5c64806a-1a21-4345-b247-59f4d8b66aac for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:35:44 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Instance destroyed successfully.
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.objects.instance [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lazy-loading 'resources' on Instance uuid 05bfe591-9892-43f4-a850-a178a2937b2f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:33:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-506131107',display_name='tempest-ServersNegativeTestJSON-server-506131107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-506131107',id=39,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:34:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6ce46509014f69a037b59466497704',ramdisk_id='',reservation_id='r-9f0b6bsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2112722000',owner_user_name='tempest-ServersNegativeTestJSON-2112722000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:34:01Z,user_data=None,user_id='499f77486ae9486990357d021d0a78cf',uuid=05bfe591-9892-43f4-a850-a178a2937b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converting VIF {"id": "5c64806a-1a21-4345-b247-59f4d8b66aac", "address": "fa:16:3e:81:56:09", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c64806a-1a", "ovs_interfaceid": "5c64806a-1a21-4345-b247-59f4d8b66aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG os_vif [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c64806a-1a, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:35:44 user nova-compute[73158]: INFO os_vif [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:56:09,bridge_name='br-int',has_traffic_filtering=True,id=5c64806a-1a21-4345-b247-59f4d8b66aac,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c64806a-1a')
Aug 17 10:35:44 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Deleting instance files /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f_del
Aug 17 10:35:44 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Deletion of /opt/stack/data/nova/instances/05bfe591-9892-43f4-a850-a178a2937b2f_del complete
Aug 17 10:35:44 user nova-compute[73158]: INFO nova.compute.manager [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 17 10:35:44 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:35:44 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Took 0.46 seconds to deallocate network for instance.
Aug 17 10:35:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:35:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:44 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Deleted allocations for instance 05bfe591-9892-43f4-a850-a178a2937b2f
Aug 17 10:35:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-93146009-cd5d-4a65-be8a-e98944c6a69b tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "05bfe591-9892-43f4-a850-a178a2937b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.526s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] Acquiring lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:35:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:35:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] Lock "05bfe591-9892-43f4-a850-a178a2937b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:35:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] No waiting events found dispatching network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:35:46 user nova-compute[73158]: WARNING nova.compute.manager [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received unexpected event network-vif-plugged-5c64806a-1a21-4345-b247-59f4d8b66aac for instance with vm_state deleted and task_state None.
Aug 17 10:35:46 user nova-compute[73158]: DEBUG nova.compute.manager [req-904e89de-105d-4831-97da-f14ae79d5f6c req-b0ceb98d-5ba1-4065-93b3-372443858361 service nova] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Received event network-vif-deleted-5c64806a-1a21-4345-b247-59f4d8b66aac {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:35:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:35:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:35:59 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268544.121276, 05bfe591-9892-43f4-a850-a178a2937b2f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:35:59 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] VM Stopped (Lifecycle Event)
Aug 17 10:35:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-212b217a-c60d-4753-a58f-14a0526bbafc None None] [instance: 05bfe591-9892-43f4-a850-a178a2937b2f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:35:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:00 user nova-compute[73158]: INFO nova.compute.manager [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Terminating instance
Aug 17 10:36:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-a596e3a4-dbb1-4ee6-866e-9b030e8b997e req-651d18b2-7861-4369-a9d6-7abc1497fe4b service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-vif-unplugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a596e3a4-dbb1-4ee6-866e-9b030e8b997e req-651d18b2-7861-4369-a9d6-7abc1497fe4b service nova] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a596e3a4-dbb1-4ee6-866e-9b030e8b997e req-651d18b2-7861-4369-a9d6-7abc1497fe4b service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a596e3a4-dbb1-4ee6-866e-9b030e8b997e req-651d18b2-7861-4369-a9d6-7abc1497fe4b service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-a596e3a4-dbb1-4ee6-866e-9b030e8b997e req-651d18b2-7861-4369-a9d6-7abc1497fe4b service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] No waiting events found dispatching network-vif-unplugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-a596e3a4-dbb1-4ee6-866e-9b030e8b997e req-651d18b2-7861-4369-a9d6-7abc1497fe4b service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-vif-unplugged-880e03b0-c705-4878-ae9b-003626236587 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:36:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Instance destroyed successfully.
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.objects.instance [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lazy-loading 'resources' on Instance uuid 300a9c6a-ed23-494d-8f26-9b5b333273f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-335647070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-335647070',id=16,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:16:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bbba4c18d534970a667590744f891a2',ramdisk_id='',reservation_id='r-3hblmtv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-184800752',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:18:18Z,user_data=None,user_id='9bfd8d8513d24d0d893689d5db089546',uuid=300a9c6a-ed23-494d-8f26-9b5b333273f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converting VIF {"id": "880e03b0-c705-4878-ae9b-003626236587", "address": "fa:16:3e:8a:f8:e7", "network": {"id": "333e61aa-31a4-4c43-af19-c183248f7326", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1203754085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bbba4c18d534970a667590744f891a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap880e03b0-c7", "ovs_interfaceid": "880e03b0-c705-4878-ae9b-003626236587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG os_vif [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap880e03b0-c7, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:36:01 user nova-compute[73158]: INFO os_vif [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:f8:e7,bridge_name='br-int',has_traffic_filtering=True,id=880e03b0-c705-4878-ae9b-003626236587,network=Network(333e61aa-31a4-4c43-af19-c183248f7326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880e03b0-c7')
Aug 17 10:36:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Deleting instance files /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4_del
Aug 17 10:36:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Deletion of /opt/stack/data/nova/instances/300a9c6a-ed23-494d-8f26-9b5b333273f4_del complete
Aug 17 10:36:01 user nova-compute[73158]: INFO nova.compute.manager [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 10:36:01 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:36:01 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:36:02 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Took 0.54 seconds to deallocate network for instance.
Aug 17 10:36:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-c1ca022a-b069-41fe-a8bb-d87a61eabffd req-fa69bf6e-78da-4cfc-8488-523da44f61d7 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-vif-deleted-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:36:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:02 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Deleted allocations for instance 300a9c6a-ed23-494d-8f26-9b5b333273f4
Aug 17 10:36:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-70dac903-c05f-4599-b490-3a73a9447612 tempest-ServerBootFromVolumeStableRescueTest-184800752 tempest-ServerBootFromVolumeStableRescueTest-184800752-project-member] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.758s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-8fa003e6-4dc8-4cc3-8624-3476a266d5b8 req-65d54005-8c3d-461c-91f8-c4eb99c2dfd3 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received event network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8fa003e6-4dc8-4cc3-8624-3476a266d5b8 req-65d54005-8c3d-461c-91f8-c4eb99c2dfd3 service nova] Acquiring lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8fa003e6-4dc8-4cc3-8624-3476a266d5b8 req-65d54005-8c3d-461c-91f8-c4eb99c2dfd3 service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8fa003e6-4dc8-4cc3-8624-3476a266d5b8 req-65d54005-8c3d-461c-91f8-c4eb99c2dfd3 service nova] Lock "300a9c6a-ed23-494d-8f26-9b5b333273f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-8fa003e6-4dc8-4cc3-8624-3476a266d5b8 req-65d54005-8c3d-461c-91f8-c4eb99c2dfd3 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] No waiting events found dispatching network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:36:03 user nova-compute[73158]: WARNING nova.compute.manager [req-8fa003e6-4dc8-4cc3-8624-3476a266d5b8 req-65d54005-8c3d-461c-91f8-c4eb99c2dfd3 service nova] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Received unexpected event network-vif-plugged-880e03b0-c705-4878-ae9b-003626236587 for instance with vm_state deleted and task_state None.
Aug 17 10:36:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:36:12 user nova-compute[73158]: INFO nova.compute.claims [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Claim successful on node user
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:36:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.policy [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '445ca2aa192a4bd38fbd59aacf99c673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4eabe57c34e5cb39756add1e33773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:36:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Creating image(s)
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "/opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "/opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "/opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.203s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk 1073741824" returned: 0 in 0.050s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Successfully created port: 73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Cannot resize image /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'migration_context' on Instance uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Ensure instance console log exists: /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Successfully updated port: 73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquired lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-changed-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Refreshing instance network info cache due to event network-changed-73049b18-de64-48ac-996a-f2f7de305945. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] Acquiring lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updating instance_info_cache with network_info: [{"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Releasing lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Instance network_info: |[{"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] Acquired lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Refreshing network info cache for port 73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Start _get_guest_xml network_info=[{"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:36:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:36:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-281920134',display_name='tempest-VolumesSnapshotTestJSON-instance-281920134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-281920134',id=40,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0VboslW3oH4t2TYcDhPldJGRn2yM8I3Z71yORiTUH+XTIlf6S98dl4RVjEGDPKL3qZyTrHAS0dKiEQczC7HKjXna4vQkxu2sfmDSPTXKcosKvcdG4ZnUknDp2T0v1paw==',key_name='tempest-keypair-2015717524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4eabe57c34e5cb39756add1e33773',ramdisk_id='',reservation_id='r-m3i7i97c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1699436377',owner_user_name='tempest-VolumesSnapshotTestJSON-1699436377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='445ca2aa192a4bd38fbd59aacf99c673',uuid=038be3bb-a7ec-49d0-80c6-8299d0d39e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converting VIF {"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'pci_devices' on Instance uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:36:14 user nova-compute[73158]:   <uuid>038be3bb-a7ec-49d0-80c6-8299d0d39e99</uuid>
Aug 17 10:36:14 user nova-compute[73158]:   <name>instance-00000028</name>
Aug 17 10:36:14 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:36:14 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:36:14 user nova-compute[73158]:   <metadata>
Aug 17 10:36:14 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:36:14 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:36:14 user nova-compute[73158]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-281920134</nova:name>
Aug 17 10:36:14 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:36:14</nova:creationTime>
Aug 17 10:36:14 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:36:14 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:36:14 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:36:14 user nova-compute[73158]:       <nova:owner>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:user uuid="445ca2aa192a4bd38fbd59aacf99c673">tempest-VolumesSnapshotTestJSON-1699436377-project-member</nova:user>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:project uuid="99c4eabe57c34e5cb39756add1e33773">tempest-VolumesSnapshotTestJSON-1699436377</nova:project>
Aug 17 10:36:14 user nova-compute[73158]:       </nova:owner>
Aug 17 10:36:14 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:36:14 user nova-compute[73158]:       <nova:ports>
Aug 17 10:36:14 user nova-compute[73158]:         <nova:port uuid="73049b18-de64-48ac-996a-f2f7de305945">
Aug 17 10:36:14 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 10:36:14 user nova-compute[73158]:         </nova:port>
Aug 17 10:36:14 user nova-compute[73158]:       </nova:ports>
Aug 17 10:36:14 user nova-compute[73158]:     </nova:instance>
Aug 17 10:36:14 user nova-compute[73158]:   </metadata>
Aug 17 10:36:14 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:36:14 user nova-compute[73158]:     <system>
Aug 17 10:36:14 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:36:14 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:36:14 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:36:14 user nova-compute[73158]:       <entry name="serial">038be3bb-a7ec-49d0-80c6-8299d0d39e99</entry>
Aug 17 10:36:14 user nova-compute[73158]:       <entry name="uuid">038be3bb-a7ec-49d0-80c6-8299d0d39e99</entry>
Aug 17 10:36:14 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:36:14 user nova-compute[73158]:     </system>
Aug 17 10:36:14 user nova-compute[73158]:   </sysinfo>
Aug 17 10:36:14 user nova-compute[73158]:   <os>
Aug 17 10:36:14 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:36:14 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:36:14 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:36:14 user nova-compute[73158]:   </os>
Aug 17 10:36:14 user nova-compute[73158]:   <features>
Aug 17 10:36:14 user nova-compute[73158]:     <acpi/>
Aug 17 10:36:14 user nova-compute[73158]:     <apic/>
Aug 17 10:36:14 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:36:14 user nova-compute[73158]:   </features>
Aug 17 10:36:14 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:36:14 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:36:14 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:36:14 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:36:14 user nova-compute[73158]:   </clock>
Aug 17 10:36:14 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:36:14 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:36:14 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:36:14 user nova-compute[73158]:   </cpu>
Aug 17 10:36:14 user nova-compute[73158]:   <devices>
Aug 17 10:36:14 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:36:14 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:36:14 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk"/>
Aug 17 10:36:14 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:36:14 user nova-compute[73158]:     </disk>
Aug 17 10:36:14 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:36:14 user nova-compute[73158]:       <mac address="fa:16:3e:f8:85:24"/>
Aug 17 10:36:14 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:36:14 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:36:14 user nova-compute[73158]:       <target dev="tap73049b18-de"/>
Aug 17 10:36:14 user nova-compute[73158]:     </interface>
Aug 17 10:36:14 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:36:14 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/console.log" append="off"/>
Aug 17 10:36:14 user nova-compute[73158]:     </serial>
Aug 17 10:36:14 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:36:14 user nova-compute[73158]:     <video>
Aug 17 10:36:14 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:36:14 user nova-compute[73158]:     </video>
Aug 17 10:36:14 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:36:14 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:36:14 user nova-compute[73158]:     </rng>
Aug 17 10:36:14 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:36:14 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:36:14 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:36:14 user nova-compute[73158]:     </memballoon>
Aug 17 10:36:14 user nova-compute[73158]:   </devices>
Aug 17 10:36:14 user nova-compute[73158]: </domain>
Aug 17 10:36:14 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-281920134',display_name='tempest-VolumesSnapshotTestJSON-instance-281920134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-281920134',id=40,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0VboslW3oH4t2TYcDhPldJGRn2yM8I3Z71yORiTUH+XTIlf6S98dl4RVjEGDPKL3qZyTrHAS0dKiEQczC7HKjXna4vQkxu2sfmDSPTXKcosKvcdG4ZnUknDp2T0v1paw==',key_name='tempest-keypair-2015717524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4eabe57c34e5cb39756add1e33773',ramdisk_id='',reservation_id='r-m3i7i97c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1699436377',owner_user_name='tempest-VolumesSnapshotTestJSON-1699436377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='445ca2aa192a4bd38fbd59aacf99c673',uuid=038be3bb-a7ec-49d0-80c6-8299d0d39e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converting VIF {"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG os_vif [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73049b18-de, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73049b18-de, col_values=(('external_ids', {'iface-id': '73049b18-de64-48ac-996a-f2f7de305945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:85:24', 'vm-uuid': '038be3bb-a7ec-49d0-80c6-8299d0d39e99'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:14 user nova-compute[73158]: INFO os_vif [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de')
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:36:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No VIF found with MAC fa:16:3e:f8:85:24, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:36:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updated VIF entry in instance network info cache for port 73049b18-de64-48ac-996a-f2f7de305945. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:36:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updating instance_info_cache with network_info: [{"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:36:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-acdfa08b-5885-4855-9b1e-b7006d24612d req-7a6d1161-2298-4d0c-a113-a136fcdc1b92 service nova] Releasing lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:36:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-b54b1d84-8a50-4fad-ba26-6ff91a5e15e4 req-44e57385-f998-4ef0-ae7a-1599e69fd6f9 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b54b1d84-8a50-4fad-ba26-6ff91a5e15e4 req-44e57385-f998-4ef0-ae7a-1599e69fd6f9 service nova] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b54b1d84-8a50-4fad-ba26-6ff91a5e15e4 req-44e57385-f998-4ef0-ae7a-1599e69fd6f9 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b54b1d84-8a50-4fad-ba26-6ff91a5e15e4 req-44e57385-f998-4ef0-ae7a-1599e69fd6f9 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-b54b1d84-8a50-4fad-ba26-6ff91a5e15e4 req-44e57385-f998-4ef0-ae7a-1599e69fd6f9 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] No waiting events found dispatching network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:36:16 user nova-compute[73158]: WARNING nova.compute.manager [req-b54b1d84-8a50-4fad-ba26-6ff91a5e15e4 req-44e57385-f998-4ef0-ae7a-1599e69fd6f9 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received unexpected event network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 for instance with vm_state building and task_state spawning.
Aug 17 10:36:16 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268561.4292378, 300a9c6a-ed23-494d-8f26-9b5b333273f4 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:36:16 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] VM Stopped (Lifecycle Event)
Aug 17 10:36:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-30dd2827-c5d0-47e1-9a9f-2ffaacce8e6d None None] [instance: 300a9c6a-ed23-494d-8f26-9b5b333273f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:17 user nova-compute[73158]: INFO nova.compute.manager [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Terminating instance
Aug 17 10:36:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-a245c50c-2dc5-4cfb-9dce-8485a9628b9e req-f3e0b0f5-7a39-496a-b4f4-0af89cbf6cd6 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-unplugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a245c50c-2dc5-4cfb-9dce-8485a9628b9e req-f3e0b0f5-7a39-496a-b4f4-0af89cbf6cd6 service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a245c50c-2dc5-4cfb-9dce-8485a9628b9e req-f3e0b0f5-7a39-496a-b4f4-0af89cbf6cd6 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a245c50c-2dc5-4cfb-9dce-8485a9628b9e req-f3e0b0f5-7a39-496a-b4f4-0af89cbf6cd6 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-a245c50c-2dc5-4cfb-9dce-8485a9628b9e req-f3e0b0f5-7a39-496a-b4f4-0af89cbf6cd6 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-unplugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:36:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-a245c50c-2dc5-4cfb-9dce-8485a9628b9e req-f3e0b0f5-7a39-496a-b4f4-0af89cbf6cd6 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-unplugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Instance destroyed successfully.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'resources' on Instance uuid e40b0f21-6d72-42b6-8877-492c974834f4 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662312586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662312586',id=35,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqzWJjkLs+Um7+LeT0Y1yIZi/Jn7nJMInkGR4GNB3+cgzO9beJMPaRfle2JgEu3GTF3Olpio2eckwGsHhh+lZ3KGPehWAx02cOSKe7vFhTYTqo/cgErNyPkZHml7HuCBA==',key_name='tempest-keypair-1462162459',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:34:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-teieknqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=e40b0f21-6d72-42b6-8877-492c974834f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "c628c076-ee40-421e-99da-03c425aa1599", "address": "fa:16:3e:40:12:f8", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc628c076-ee", "ovs_interfaceid": "c628c076-ee40-421e-99da-03c425aa1599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG os_vif [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc628c076-ee, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:18 user nova-compute[73158]: INFO os_vif [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=c628c076-ee40-421e-99da-03c425aa1599,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc628c076-ee')
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Deleting instance files /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4_del
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Deletion of /opt/stack/data/nova/instances/e40b0f21-6d72-42b6-8877-492c974834f4_del complete
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-04d1729d-c80f-4325-bffb-fdfd54f316c8 req-c5b59194-d1a9-498c-b107-f95e18169675 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-04d1729d-c80f-4325-bffb-fdfd54f316c8 req-c5b59194-d1a9-498c-b107-f95e18169675 service nova] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-04d1729d-c80f-4325-bffb-fdfd54f316c8 req-c5b59194-d1a9-498c-b107-f95e18169675 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-04d1729d-c80f-4325-bffb-fdfd54f316c8 req-c5b59194-d1a9-498c-b107-f95e18169675 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-04d1729d-c80f-4325-bffb-fdfd54f316c8 req-c5b59194-d1a9-498c-b107-f95e18169675 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] No waiting events found dispatching network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:36:18 user nova-compute[73158]: WARNING nova.compute.manager [req-04d1729d-c80f-4325-bffb-fdfd54f316c8 req-c5b59194-d1a9-498c-b107-f95e18169675 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received unexpected event network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 for instance with vm_state building and task_state spawning.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268578.4551582, 038be3bb-a7ec-49d0-80c6-8299d0d39e99 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] VM Resumed (Lifecycle Event)
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Instance spawned successfully.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268578.4563377, 038be3bb-a7ec-49d0-80c6-8299d0d39e99 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] VM Started (Lifecycle Event)
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:36:18 user nova-compute[73158]: INFO nova.compute.manager [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Took 6.34 seconds to build instance.
Aug 17 10:36:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-481a2f45-0950-4606-9f51-04e77758cda9 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.444s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:36:19 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Took 1.01 seconds to deallocate network for instance.
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:19 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Deleted allocations for instance e40b0f21-6d72-42b6-8877-492c974834f4
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-153891a0-4ea3-46d4-ae32-cede7c26a62e tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "e40b0f21-6d72-42b6-8877-492c974834f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] Acquiring lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] Lock "e40b0f21-6d72-42b6-8877-492c974834f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] No waiting events found dispatching network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:36:19 user nova-compute[73158]: WARNING nova.compute.manager [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received unexpected event network-vif-plugged-c628c076-ee40-421e-99da-03c425aa1599 for instance with vm_state deleted and task_state None.
Aug 17 10:36:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-3ec4d452-26a4-4257-ba79-50932d038f2f req-a46cfa53-fb6c-4bb5-8b7a-a8b926f2f607 service nova] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Received event network-vif-deleted-c628c076-ee40-421e-99da-03c425aa1599 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:36:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:33 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268578.1105008, e40b0f21-6d72-42b6-8877-492c974834f4 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:36:33 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] VM Stopped (Lifecycle Event)
Aug 17 10:36:33 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3e73f3a6-f4a2-4ba1-aada-2c9350cd50b4 None None] [instance: e40b0f21-6d72-42b6-8877-492c974834f4] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:36:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:36:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updating instance_info_cache with network_info: [{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:36:43 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:36:44 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:36:44 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=24.253345489501953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:36:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:36:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:36:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:36:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:36:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:37:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:11 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:37:11 user nova-compute[73158]: INFO nova.compute.claims [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Claim successful on node user
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:37:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:37:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Creating image(s)
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.policy [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbf2fd52d7184d43aa53bf0d9b2afeca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e64443813742dca6185cfd559df272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:37:12 user nova-compute[73158]: INFO nova.compute.claims [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Claim successful on node user
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.200s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk 1073741824" returned: 0 in 0.068s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.207s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Successfully created port: f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:37:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:37:13 user nova-compute[73158]: INFO nova.virt.block_device [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Booting with volume 95310979-dda4-4af8-bd92-9276fabc84d0 at /dev/vda
Aug 17 10:37:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Cannot resize image /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'migration_context' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Ensure instance console log exists: /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG os_brick.utils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadb7935-4e5c-4fca-86f2-8d3443a5be65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a67a9f-f072-4d0d-9478-89f57147d8cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d2641-a03a-4924-a747-a2541a445b70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[824c05f6-1949-49d7-817d-bc7222cf9ad8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:37:13 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:37:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1703599c-0fda-4b9d-bc1e-f4c3409b0c35]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG os_brick.utils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating existing volume attachment record: ffe6e981-83ca-4c33-af2f-4561df76d927 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:37:13 user nova-compute[73158]: DEBUG nova.policy [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9fa4a680274585a7a81ee20321f52b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec52d227e61d40e38a321db08737f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Successfully updated port: f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing instance network info cache due to event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:37:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Successfully created port: 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.network.neutron [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance network_info: |[{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Start _get_guest_xml network_info=[{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:37:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:37:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324139457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324139457',id=41,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnMfzOdZyb+byLQqZLSZVbvEC9w/CDMq3NcG69yGgNk4+kqpx8giB6xj6gtHmcfalSHP+T97uv92/6V7IA44lBa7MftMPtoCTyIQEWesv3TsuekzGLI1RsjZzeLwBcERA==',key_name='tempest-keypair-42577443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-dx6jo9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=8c6322c6-8362-4ed0-b0b3-0b948678a62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:37:15 user nova-compute[73158]:   <uuid>8c6322c6-8362-4ed0-b0b3-0b948678a62e</uuid>
Aug 17 10:37:15 user nova-compute[73158]:   <name>instance-00000029</name>
Aug 17 10:37:15 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:37:15 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:37:15 user nova-compute[73158]:   <metadata>
Aug 17 10:37:15 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:37:15 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:37:15 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-324139457</nova:name>
Aug 17 10:37:15 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:37:15</nova:creationTime>
Aug 17 10:37:15 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:37:15 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:37:15 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:37:15 user nova-compute[73158]:       <nova:owner>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:user uuid="cbf2fd52d7184d43aa53bf0d9b2afeca">tempest-AttachVolumeShelveTestJSON-1136258329-project-member</nova:user>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:project uuid="26e64443813742dca6185cfd559df272">tempest-AttachVolumeShelveTestJSON-1136258329</nova:project>
Aug 17 10:37:15 user nova-compute[73158]:       </nova:owner>
Aug 17 10:37:15 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:37:15 user nova-compute[73158]:       <nova:ports>
Aug 17 10:37:15 user nova-compute[73158]:         <nova:port uuid="f18d69ba-6933-4c36-b759-9265fbf2bcc3">
Aug 17 10:37:15 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:37:15 user nova-compute[73158]:         </nova:port>
Aug 17 10:37:15 user nova-compute[73158]:       </nova:ports>
Aug 17 10:37:15 user nova-compute[73158]:     </nova:instance>
Aug 17 10:37:15 user nova-compute[73158]:   </metadata>
Aug 17 10:37:15 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:37:15 user nova-compute[73158]:     <system>
Aug 17 10:37:15 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:37:15 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:37:15 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:37:15 user nova-compute[73158]:       <entry name="serial">8c6322c6-8362-4ed0-b0b3-0b948678a62e</entry>
Aug 17 10:37:15 user nova-compute[73158]:       <entry name="uuid">8c6322c6-8362-4ed0-b0b3-0b948678a62e</entry>
Aug 17 10:37:15 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:37:15 user nova-compute[73158]:     </system>
Aug 17 10:37:15 user nova-compute[73158]:   </sysinfo>
Aug 17 10:37:15 user nova-compute[73158]:   <os>
Aug 17 10:37:15 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:37:15 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:37:15 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:37:15 user nova-compute[73158]:   </os>
Aug 17 10:37:15 user nova-compute[73158]:   <features>
Aug 17 10:37:15 user nova-compute[73158]:     <acpi/>
Aug 17 10:37:15 user nova-compute[73158]:     <apic/>
Aug 17 10:37:15 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:37:15 user nova-compute[73158]:   </features>
Aug 17 10:37:15 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:37:15 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:37:15 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:37:15 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:37:15 user nova-compute[73158]:   </clock>
Aug 17 10:37:15 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:37:15 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:37:15 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:37:15 user nova-compute[73158]:   </cpu>
Aug 17 10:37:15 user nova-compute[73158]:   <devices>
Aug 17 10:37:15 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:37:15 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:37:15 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk"/>
Aug 17 10:37:15 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:37:15 user nova-compute[73158]:     </disk>
Aug 17 10:37:15 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:37:15 user nova-compute[73158]:       <mac address="fa:16:3e:ee:7f:61"/>
Aug 17 10:37:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:37:15 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:37:15 user nova-compute[73158]:       <target dev="tapf18d69ba-69"/>
Aug 17 10:37:15 user nova-compute[73158]:     </interface>
Aug 17 10:37:15 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:37:15 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/console.log" append="off"/>
Aug 17 10:37:15 user nova-compute[73158]:     </serial>
Aug 17 10:37:15 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:37:15 user nova-compute[73158]:     <video>
Aug 17 10:37:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:37:15 user nova-compute[73158]:     </video>
Aug 17 10:37:15 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:37:15 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:37:15 user nova-compute[73158]:     </rng>
Aug 17 10:37:15 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:37:15 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:37:15 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:37:15 user nova-compute[73158]:     </memballoon>
Aug 17 10:37:15 user nova-compute[73158]:   </devices>
Aug 17 10:37:15 user nova-compute[73158]: </domain>
Aug 17 10:37:15 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324139457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324139457',id=41,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnMfzOdZyb+byLQqZLSZVbvEC9w/CDMq3NcG69yGgNk4+kqpx8giB6xj6gtHmcfalSHP+T97uv92/6V7IA44lBa7MftMPtoCTyIQEWesv3TsuekzGLI1RsjZzeLwBcERA==',key_name='tempest-keypair-42577443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-dx6jo9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=8c6322c6-8362-4ed0-b0b3-0b948678a62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG os_vif [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf18d69ba-69, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf18d69ba-69, col_values=(('external_ids', {'iface-id': 'f18d69ba-6933-4c36-b759-9265fbf2bcc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:7f:61', 'vm-uuid': '8c6322c6-8362-4ed0-b0b3-0b948678a62e'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:15 user nova-compute[73158]: INFO os_vif [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69')
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:37:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No VIF found with MAC fa:16:3e:ee:7f:61, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updated VIF entry in instance network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cbacf9e8-8946-4a17-b6dd-d68738edef8e req-7dd3db39-d381-4005-aa53-c4970e3a038f service nova] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Successfully updated port: 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance network_info: |[{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.compute.manager [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing instance network info cache due to event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:37:16 user nova-compute[73158]: DEBUG nova.network.neutron [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-f23fdfa1-802f-4b10-960c-aca38b741317 req-02b2ba46-556e-465d-8480-7ba3576e7a00 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f23fdfa1-802f-4b10-960c-aca38b741317 req-02b2ba46-556e-465d-8480-7ba3576e7a00 service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f23fdfa1-802f-4b10-960c-aca38b741317 req-02b2ba46-556e-465d-8480-7ba3576e7a00 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f23fdfa1-802f-4b10-960c-aca38b741317 req-02b2ba46-556e-465d-8480-7ba3576e7a00 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-f23fdfa1-802f-4b10-960c-aca38b741317 req-02b2ba46-556e-465d-8480-7ba3576e7a00 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:37:17 user nova-compute[73158]: WARNING nova.compute.manager [req-f23fdfa1-802f-4b10-960c-aca38b741317 req-02b2ba46-556e-465d-8480-7ba3576e7a00 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state building and task_state spawning.
Aug 17 10:37:17 user nova-compute[73158]: DEBUG nova.network.neutron [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updated VIF entry in instance network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG nova.network.neutron [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-171907c6-1c8b-403f-b8cc-07bdcade5942 req-c5c190e5-31c9-414e-ba36-a27d1dbeb709 service nova] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-a839f8d3-4726-44fd-827e-cb703e6b84c1 req-b8849ffc-3496-4072-b41f-c1515be8eefc service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a839f8d3-4726-44fd-827e-cb703e6b84c1 req-b8849ffc-3496-4072-b41f-c1515be8eefc service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a839f8d3-4726-44fd-827e-cb703e6b84c1 req-b8849ffc-3496-4072-b41f-c1515be8eefc service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a839f8d3-4726-44fd-827e-cb703e6b84c1 req-b8849ffc-3496-4072-b41f-c1515be8eefc service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-a839f8d3-4726-44fd-827e-cb703e6b84c1 req-b8849ffc-3496-4072-b41f-c1515be8eefc service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:37:19 user nova-compute[73158]: WARNING nova.compute.manager [req-a839f8d3-4726-44fd-827e-cb703e6b84c1 req-b8849ffc-3496-4072-b41f-c1515be8eefc service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state building and task_state spawning.
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268639.0735161, 8c6322c6-8362-4ed0-b0b3-0b948678a62e => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] VM Resumed (Lifecycle Event)
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance spawned successfully.
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268639.0748346, 8c6322c6-8362-4ed0-b0b3-0b948678a62e => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] VM Started (Lifecycle Event)
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 17 10:37:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:37:19 user nova-compute[73158]: INFO nova.compute.manager [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Took 7.41 seconds to build instance.
Aug 17 10:37:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-063d55af-1c66-4558-a132-10f54faa64f4 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.576s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:37:24 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Creating image(s)
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Ensure instance console log exists: /opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Start _get_guest_xml network_info=[{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'ffe6e981-83ca-4c33-af2f-4561df76d927', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f', 'attached_at': '', 'detached_at': '', 'volume_id': '95310979-dda4-4af8-bd92-9276fabc84d0', 'serial': '95310979-dda4-4af8-bd92-9276fabc84d0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:37:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:37:24 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:37:24 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:37:24 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:37:24 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[71276976-c898-4364-b2ad-4710227d5323]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:37:24 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4376e8c-5f5f-4c19-b6cf-81ea8fa6bc9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0] added
Aug 17 10:37:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22464d8-5fbd-47b9-8ec1-2ef4503f505b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bee83b-08b0-40bb-a6b9-4fa9f8619b97]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNEnmUcL {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNEnmUcL" returned: 0 in 0.035s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ce2e6-ae1a-44fd-b5cd-8ba8d7143b49]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNEnmUcL'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[12202bd4-d58a-47a6-9f87-3683ba4887e5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f3fc7-1ab3-460f-a73f-8cb36e627dc4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:37:24 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:37:24 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:37:24 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:37:24 user nova-compute[73158]: 
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d096e276-24ca-479c-9339-72d5155c9bb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]
Aug 17 10:37:24 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.
Aug 17 10:37:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23cda4-468c-4435-bab7-1d33cd53b750]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5061b894-613f-4908-8b8c-7af6a12f68ee]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:37:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:37:24 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ccd222-f4dc-4c9d-87e7-bd58ccba427f]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:37:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26634383664313532', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634383664313532', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-23641761',display_name='tempest-TestShelveInstance-server-23641761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-23641761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJt9oZogk+KTs0ars1cOwQiQCcCeDk5+7ckHbcMSgdZqjUvo4MFeDd8VIaxhvLn0HKtL+Kkuqp//H8+SFrxbct2KiBQP2VwF/OZ38kgZvZtJrxmBsxKfOB4TbtZHSWCA==',key_name='tempest-TestShelveInstance-797172059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec52d227e61d40e38a321db08737f649',ramdisk_id='',reservation_id='r-1hlk3ygk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-357169844',owner_user_name='tempest-TestShelveInstance-357169844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:37:13Z,user_data=None,user_id='eb9fa4a680274585a7a81ee20321f52b',uuid=fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converting VIF {"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.objects.instance [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'pci_devices' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:37:25 user nova-compute[73158]:   <uuid>fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f</uuid>
Aug 17 10:37:25 user nova-compute[73158]:   <name>instance-0000002a</name>
Aug 17 10:37:25 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:37:25 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:37:25 user nova-compute[73158]:   <metadata>
Aug 17 10:37:25 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:37:25 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:37:25 user nova-compute[73158]:       <nova:name>tempest-TestShelveInstance-server-23641761</nova:name>
Aug 17 10:37:25 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:37:24</nova:creationTime>
Aug 17 10:37:25 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:37:25 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:37:25 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:37:25 user nova-compute[73158]:       <nova:owner>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:user uuid="eb9fa4a680274585a7a81ee20321f52b">tempest-TestShelveInstance-357169844-project-member</nova:user>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:project uuid="ec52d227e61d40e38a321db08737f649">tempest-TestShelveInstance-357169844</nova:project>
Aug 17 10:37:25 user nova-compute[73158]:       </nova:owner>
Aug 17 10:37:25 user nova-compute[73158]:       <nova:ports>
Aug 17 10:37:25 user nova-compute[73158]:         <nova:port uuid="48f8ecc4-3585-4edc-9fef-b1db4e2335a5">
Aug 17 10:37:25 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 10:37:25 user nova-compute[73158]:         </nova:port>
Aug 17 10:37:25 user nova-compute[73158]:       </nova:ports>
Aug 17 10:37:25 user nova-compute[73158]:     </nova:instance>
Aug 17 10:37:25 user nova-compute[73158]:   </metadata>
Aug 17 10:37:25 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:37:25 user nova-compute[73158]:     <system>
Aug 17 10:37:25 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:37:25 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:37:25 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:37:25 user nova-compute[73158]:       <entry name="serial">fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f</entry>
Aug 17 10:37:25 user nova-compute[73158]:       <entry name="uuid">fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f</entry>
Aug 17 10:37:25 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:37:25 user nova-compute[73158]:     </system>
Aug 17 10:37:25 user nova-compute[73158]:   </sysinfo>
Aug 17 10:37:25 user nova-compute[73158]:   <os>
Aug 17 10:37:25 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:37:25 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:37:25 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:37:25 user nova-compute[73158]:   </os>
Aug 17 10:37:25 user nova-compute[73158]:   <features>
Aug 17 10:37:25 user nova-compute[73158]:     <acpi/>
Aug 17 10:37:25 user nova-compute[73158]:     <apic/>
Aug 17 10:37:25 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:37:25 user nova-compute[73158]:   </features>
Aug 17 10:37:25 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:37:25 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:37:25 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:37:25 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:37:25 user nova-compute[73158]:   </clock>
Aug 17 10:37:25 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:37:25 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:37:25 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:37:25 user nova-compute[73158]:   </cpu>
Aug 17 10:37:25 user nova-compute[73158]:   <devices>
Aug 17 10:37:25 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:37:25 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:37:25 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:37:25 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:37:25 user nova-compute[73158]:       <serial>95310979-dda4-4af8-bd92-9276fabc84d0</serial>
Aug 17 10:37:25 user nova-compute[73158]:     </disk>
Aug 17 10:37:25 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:37:25 user nova-compute[73158]:       <mac address="fa:16:3e:86:b3:88"/>
Aug 17 10:37:25 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:37:25 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:37:25 user nova-compute[73158]:       <target dev="tap48f8ecc4-35"/>
Aug 17 10:37:25 user nova-compute[73158]:     </interface>
Aug 17 10:37:25 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:37:25 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f/console.log" append="off"/>
Aug 17 10:37:25 user nova-compute[73158]:     </serial>
Aug 17 10:37:25 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:37:25 user nova-compute[73158]:     <video>
Aug 17 10:37:25 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:37:25 user nova-compute[73158]:     </video>
Aug 17 10:37:25 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:37:25 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:37:25 user nova-compute[73158]:     </rng>
Aug 17 10:37:25 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:37:25 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:37:25 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:37:25 user nova-compute[73158]:     </memballoon>
Aug 17 10:37:25 user nova-compute[73158]:   </devices>
Aug 17 10:37:25 user nova-compute[73158]: </domain>
Aug 17 10:37:25 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-23641761',display_name='tempest-TestShelveInstance-server-23641761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-23641761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJt9oZogk+KTs0ars1cOwQiQCcCeDk5+7ckHbcMSgdZqjUvo4MFeDd8VIaxhvLn0HKtL+Kkuqp//H8+SFrxbct2KiBQP2VwF/OZ38kgZvZtJrxmBsxKfOB4TbtZHSWCA==',key_name='tempest-TestShelveInstance-797172059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec52d227e61d40e38a321db08737f649',ramdisk_id='',reservation_id='r-1hlk3ygk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-357169844',owner_user_name='tempest-TestShelveInstance-357169844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:37:13Z,user_data=None,user_id='eb9fa4a680274585a7a81ee20321f52b',uuid=fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converting VIF {"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG os_vif [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48f8ecc4-35, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48f8ecc4-35, col_values=(('external_ids', {'iface-id': '48f8ecc4-3585-4edc-9fef-b1db4e2335a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:b3:88', 'vm-uuid': 'fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:37:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:25 user nova-compute[73158]: INFO os_vif [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35')
Aug 17 10:37:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:37:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] No VIF found with MAC fa:16:3e:86:b3:88, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-3abe766b-55c5-434d-819e-237801566e4c req-f63579cb-1f4c-4f2b-845a-7b3eee6dd4dd service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3abe766b-55c5-434d-819e-237801566e4c req-f63579cb-1f4c-4f2b-845a-7b3eee6dd4dd service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3abe766b-55c5-434d-819e-237801566e4c req-f63579cb-1f4c-4f2b-845a-7b3eee6dd4dd service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3abe766b-55c5-434d-819e-237801566e4c req-f63579cb-1f4c-4f2b-845a-7b3eee6dd4dd service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:27 user nova-compute[73158]: DEBUG nova.compute.manager [req-3abe766b-55c5-434d-819e-237801566e4c req-f63579cb-1f4c-4f2b-845a-7b3eee6dd4dd service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:37:27 user nova-compute[73158]: WARNING nova.compute.manager [req-3abe766b-55c5-434d-819e-237801566e4c req-f63579cb-1f4c-4f2b-845a-7b3eee6dd4dd service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state building and task_state spawning.
Aug 17 10:37:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268649.7069848, fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] VM Resumed (Lifecycle Event)
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e5de424-e677-4683-86b8-7c9e6f472c34 req-3c370c6a-e2e3-4063-96e3-ec97795f0ed4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e5de424-e677-4683-86b8-7c9e6f472c34 req-3c370c6a-e2e3-4063-96e3-ec97795f0ed4 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e5de424-e677-4683-86b8-7c9e6f472c34 req-3c370c6a-e2e3-4063-96e3-ec97795f0ed4 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1e5de424-e677-4683-86b8-7c9e6f472c34 req-3c370c6a-e2e3-4063-96e3-ec97795f0ed4 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-1e5de424-e677-4683-86b8-7c9e6f472c34 req-3c370c6a-e2e3-4063-96e3-ec97795f0ed4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:37:29 user nova-compute[73158]: WARNING nova.compute.manager [req-1e5de424-e677-4683-86b8-7c9e6f472c34 req-3c370c6a-e2e3-4063-96e3-ec97795f0ed4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state building and task_state spawning.
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance spawned successfully.
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268649.7082539, fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] VM Started (Lifecycle Event)
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 17 10:37:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:37:29 user nova-compute[73158]: INFO nova.compute.manager [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Took 17.40 seconds to build instance.
Aug 17 10:37:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-307a149f-155e-4885-833b-7af761436ed0 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.508s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:37 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:37:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:37:43 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updating instance_info_cache with network_info: [{"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:37:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:37:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:37:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:44 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:46 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:37:46 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8183MB free_disk=24.20261001586914GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8c6322c6-8362-4ed0-b0b3-0b948678a62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:37:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:48 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:37:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:37:48 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:37:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:37:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:37:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:37:59 user nova-compute[73158]: INFO nova.compute.claims [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Claim successful on node user
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:37:59 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.policy [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da6612da12d4678a8959dbe165ccf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94f96ada7624645a1ae4cf6b9d93c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:37:59 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Creating image(s)
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "/opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "/opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.182s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:37:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.270s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk 1073741824" returned: 0 in 0.052s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Successfully created port: a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Cannot resize image /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'migration_context' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Ensure instance console log exists: /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Successfully updated port: a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquired lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-changed-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Refreshing instance network info cache due to event network-changed-a591b7b9-a8a6-4e89-9069-50ca84356268. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] Acquiring lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating instance_info_cache with network_info: [{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Releasing lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Instance network_info: |[{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] Acquired lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Refreshing network info cache for port a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Start _get_guest_xml network_info=[{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:38:01 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:38:01 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1110044070',display_name='tempest-TestServerVolumeAttachmentScenario-server-1110044070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1110044070',id=43,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6Ln3MEutJdeQ+D1Kar90cahgmDPwatOpDJ6EWgmUq93VeKxcEgQll3GLQdcTahAQN7zHflB2vhXVI0eCu7WKD+TFWx56AlBQMsQgxrBke94C6ID7zp44iDEOLbCESyyQ==',key_name='tempest-keypair-889200883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b94f96ada7624645a1ae4cf6b9d93c83',ramdisk_id='',reservation_id='r-j7fbm06q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1057603411',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1057603411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da6612da12d4678a8959dbe165ccf63',uuid=c1d6d694-680c-45d0-9d4e-2c3d2217880e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Converting VIF {"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'pci_devices' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:38:01 user nova-compute[73158]:   <uuid>c1d6d694-680c-45d0-9d4e-2c3d2217880e</uuid>
Aug 17 10:38:01 user nova-compute[73158]:   <name>instance-0000002b</name>
Aug 17 10:38:01 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:38:01 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:38:01 user nova-compute[73158]:   <metadata>
Aug 17 10:38:01 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:38:01 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:38:01 user nova-compute[73158]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1110044070</nova:name>
Aug 17 10:38:01 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:38:01</nova:creationTime>
Aug 17 10:38:01 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:38:01 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:38:01 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:38:01 user nova-compute[73158]:       <nova:owner>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:user uuid="6da6612da12d4678a8959dbe165ccf63">tempest-TestServerVolumeAttachmentScenario-1057603411-project-member</nova:user>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:project uuid="b94f96ada7624645a1ae4cf6b9d93c83">tempest-TestServerVolumeAttachmentScenario-1057603411</nova:project>
Aug 17 10:38:01 user nova-compute[73158]:       </nova:owner>
Aug 17 10:38:01 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:38:01 user nova-compute[73158]:       <nova:ports>
Aug 17 10:38:01 user nova-compute[73158]:         <nova:port uuid="a591b7b9-a8a6-4e89-9069-50ca84356268">
Aug 17 10:38:01 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:38:01 user nova-compute[73158]:         </nova:port>
Aug 17 10:38:01 user nova-compute[73158]:       </nova:ports>
Aug 17 10:38:01 user nova-compute[73158]:     </nova:instance>
Aug 17 10:38:01 user nova-compute[73158]:   </metadata>
Aug 17 10:38:01 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:38:01 user nova-compute[73158]:     <system>
Aug 17 10:38:01 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:38:01 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:38:01 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:38:01 user nova-compute[73158]:       <entry name="serial">c1d6d694-680c-45d0-9d4e-2c3d2217880e</entry>
Aug 17 10:38:01 user nova-compute[73158]:       <entry name="uuid">c1d6d694-680c-45d0-9d4e-2c3d2217880e</entry>
Aug 17 10:38:01 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:38:01 user nova-compute[73158]:     </system>
Aug 17 10:38:01 user nova-compute[73158]:   </sysinfo>
Aug 17 10:38:01 user nova-compute[73158]:   <os>
Aug 17 10:38:01 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:38:01 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:38:01 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:38:01 user nova-compute[73158]:   </os>
Aug 17 10:38:01 user nova-compute[73158]:   <features>
Aug 17 10:38:01 user nova-compute[73158]:     <acpi/>
Aug 17 10:38:01 user nova-compute[73158]:     <apic/>
Aug 17 10:38:01 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:38:01 user nova-compute[73158]:   </features>
Aug 17 10:38:01 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:38:01 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:38:01 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:38:01 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:38:01 user nova-compute[73158]:   </clock>
Aug 17 10:38:01 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:38:01 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:38:01 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:38:01 user nova-compute[73158]:   </cpu>
Aug 17 10:38:01 user nova-compute[73158]:   <devices>
Aug 17 10:38:01 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:38:01 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:38:01 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk"/>
Aug 17 10:38:01 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:38:01 user nova-compute[73158]:     </disk>
Aug 17 10:38:01 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:38:01 user nova-compute[73158]:       <mac address="fa:16:3e:26:5f:6c"/>
Aug 17 10:38:01 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:38:01 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:38:01 user nova-compute[73158]:       <target dev="tapa591b7b9-a8"/>
Aug 17 10:38:01 user nova-compute[73158]:     </interface>
Aug 17 10:38:01 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:38:01 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/console.log" append="off"/>
Aug 17 10:38:01 user nova-compute[73158]:     </serial>
Aug 17 10:38:01 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:38:01 user nova-compute[73158]:     <video>
Aug 17 10:38:01 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:38:01 user nova-compute[73158]:     </video>
Aug 17 10:38:01 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:38:01 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:38:01 user nova-compute[73158]:     </rng>
Aug 17 10:38:01 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:38:01 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:38:01 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:38:01 user nova-compute[73158]:     </memballoon>
Aug 17 10:38:01 user nova-compute[73158]:   </devices>
Aug 17 10:38:01 user nova-compute[73158]: </domain>
Aug 17 10:38:01 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1110044070',display_name='tempest-TestServerVolumeAttachmentScenario-server-1110044070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1110044070',id=43,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6Ln3MEutJdeQ+D1Kar90cahgmDPwatOpDJ6EWgmUq93VeKxcEgQll3GLQdcTahAQN7zHflB2vhXVI0eCu7WKD+TFWx56AlBQMsQgxrBke94C6ID7zp44iDEOLbCESyyQ==',key_name='tempest-keypair-889200883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b94f96ada7624645a1ae4cf6b9d93c83',ramdisk_id='',reservation_id='r-j7fbm06q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1057603411',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1057603411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da6612da12d4678a8959dbe165ccf63',uuid=c1d6d694-680c-45d0-9d4e-2c3d2217880e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Converting VIF {"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG os_vif [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa591b7b9-a8, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa591b7b9-a8, col_values=(('external_ids', {'iface-id': 'a591b7b9-a8a6-4e89-9069-50ca84356268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:5f:6c', 'vm-uuid': 'c1d6d694-680c-45d0-9d4e-2c3d2217880e'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:01 user nova-compute[73158]: INFO os_vif [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8')
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:38:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No VIF found with MAC fa:16:3e:26:5f:6c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:38:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updated VIF entry in instance network info cache for port a591b7b9-a8a6-4e89-9069-50ca84356268. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:38:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating instance_info_cache with network_info: [{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:38:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f6087efa-3a62-4995-ab5e-0b998d4fc804 req-1d12e82a-da63-4c9e-aa2a-c90ab46b8088 service nova] Releasing lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:38:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-55597e04-a2a7-497f-9f7c-dafbaabe9f70 req-fc5b3b5b-94f7-4a0d-b784-9704706fc869 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-55597e04-a2a7-497f-9f7c-dafbaabe9f70 req-fc5b3b5b-94f7-4a0d-b784-9704706fc869 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-55597e04-a2a7-497f-9f7c-dafbaabe9f70 req-fc5b3b5b-94f7-4a0d-b784-9704706fc869 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-55597e04-a2a7-497f-9f7c-dafbaabe9f70 req-fc5b3b5b-94f7-4a0d-b784-9704706fc869 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-55597e04-a2a7-497f-9f7c-dafbaabe9f70 req-fc5b3b5b-94f7-4a0d-b784-9704706fc869 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:38:03 user nova-compute[73158]: WARNING nova.compute.manager [req-55597e04-a2a7-497f-9f7c-dafbaabe9f70 req-fc5b3b5b-94f7-4a0d-b784-9704706fc869 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state building and task_state spawning.
Aug 17 10:38:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'flavor' on Instance uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:38:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Ignoring supplied device name: /dev/vdb
Aug 17 10:38:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:04 user nova-compute[73158]: INFO nova.compute.manager [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Attaching volume 1b3eac5a-562f-44da-bbd2-c4dc859123c9 to /dev/vdb
Aug 17 10:38:04 user nova-compute[73158]: DEBUG os_brick.utils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[701ebc9e-d295-40d9-95ec-a1ffa2b0aea9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb007014-5b5d-4687-baf9-7a6d7f28c8ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919346f-6cb7-475f-96c5-62e2ac6d4d8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09aa512-8b61-4549-8a53-1e42536b03b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:38:04 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:38:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725d04c-77a5-42fb-a0f8-49b30c51aff7]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG os_brick.utils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:38:04 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updating existing volume attachment record: 700d979e-c649-49c9-a0ce-4d0df39c3d1e {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268685.0861218, c1d6d694-680c-45d0-9d4e-2c3d2217880e => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] VM Resumed (Lifecycle Event)
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Instance spawned successfully.
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268685.0866559, c1d6d694-680c-45d0-9d4e-2c3d2217880e => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] VM Started (Lifecycle Event)
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:38:05 user nova-compute[73158]: INFO nova.compute.manager [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Took 6.24 seconds to build instance.
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d50c0888-c9a8-4f55-aaea-c88d868d980f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-changed-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Refreshing instance network info cache due to event network-changed-73049b18-de64-48ac-996a-f2f7de305945. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] Acquiring lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] Acquired lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Refreshing network info cache for port 73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updated VIF entry in instance network info cache for port 73049b18-de64-48ac-996a-f2f7de305945. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updating instance_info_cache with network_info: [{"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] Releasing lock "refresh_cache-038be3bb-a7ec-49d0-80c6-8299d0d39e99" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:38:05 user nova-compute[73158]: WARNING nova.compute.manager [req-a2cd0899-6b8f-40d8-89cc-200c3c8bbb85 req-187f647c-b2c5-4b1a-b38d-f8d77a78d79d service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state active and task_state None.
Aug 17 10:38:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZPeCuzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:38:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:38:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:38:14 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413069e-be50-4409-b61f-24c3545464d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:38:14 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76fb34e-dcc2-41a1-ace1-2e6a41a082c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9] added
Aug 17 10:38:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaf6b29-c053-4c7f-98aa-3cff9ed8c770]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe324bdf-7524-4858-9797-4073268a8bb6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZPeCuzx {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZPeCuzx" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7880e6-617b-4ce9-aed0-87a03530afd0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TZPeCuzx'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3bab29-b81d-4247-886c-d8b9e1e9978f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2035b-bbbe-4426-8cc2-508842d45092]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:38:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:38:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb76f4d8-d005-4d94-a42b-7ffc556495b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260]
Aug 17 10:38:14 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260] successful.
Aug 17 10:38:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0403dd-5915-481e-aab3-a0f13f392b52]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:38:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[efab83dc-f033-4b81-a134-1ade98b971ce]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:38:15 user nova-compute[73158]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 (non-flash)
Aug 17 10:38:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:38:15 user nova-compute[73158]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 (non-flash)
Aug 17 10:38:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630fa1b-4a92-458b-80cb-61587630969b]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:38:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZPeCuzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23038306335363265', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038306335363265', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'flavor' on Instance uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:38:16 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:38:16 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:38:16 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:38:16 user nova-compute[73158]:   <serial>1b3eac5a-562f-44da-bbd2-c4dc859123c9</serial>
Aug 17 10:38:16 user nova-compute[73158]: </disk>
Aug 17 10:38:16 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No VIF found with MAC fa:16:3e:f8:85:24, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a038642e-37f0-49b4-9acf-d5600ea470af tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.656s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:22 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:40 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updating instance_info_cache with network_info: [{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:38:45 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:38:47 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:38:47 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8093MB free_disk=24.163406372070312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8c6322c6-8362-4ed0-b0b3-0b948678a62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c1d6d694-680c-45d0-9d4e-2c3d2217880e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:38:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:38:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:01 user nova-compute[73158]: INFO nova.compute.manager [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Detaching volume 1b3eac5a-562f-44da-bbd2-c4dc859123c9
Aug 17 10:39:01 user nova-compute[73158]: INFO nova.virt.block_device [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Attempting to driver detach volume 1b3eac5a-562f-44da-bbd2-c4dc859123c9 from mountpoint /dev/vdb
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Attempting to detach device vdb from instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:39:01 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:39:01 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:39:01 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:39:01 user nova-compute[73158]:   <serial>1b3eac5a-562f-44da-bbd2-c4dc859123c9</serial>
Aug 17 10:39:01 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:39:01 user nova-compute[73158]: </disk>
Aug 17 10:39:01 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:39:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully detached device vdb from instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 from the persistent domain config.
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:39:01 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:39:01 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:39:01 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:39:01 user nova-compute[73158]:   <serial>1b3eac5a-562f-44da-bbd2-c4dc859123c9</serial>
Aug 17 10:39:01 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:39:01 user nova-compute[73158]: </disk>
Aug 17 10:39:01 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268741.7936764, 038be3bb-a7ec-49d0-80c6-8299d0d39e99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:39:01 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully detached device vdb from instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99 from the live domain config.
Aug 17 10:39:01 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZPeCuzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:39:01 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3ec36-2ccc-4042-81a4-cdd4e1caebf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbe886d-7766-43d8-8201-01ca3dee53f6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:39:01 user nova-compute[73158]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 (non-flash)
Aug 17 10:39:01 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:39:01 user nova-compute[73158]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 (non-flash)
Aug 17 10:39:01 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c4dacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c9b58-6d47-487f-9209-7fd88265e74f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce95116-9481-4ee8-9afe-014298eeb4e2]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0effedd-fa44-4978-8fd8-04f61a42bd6c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9227177-8c40-4894-95de-fd29ee6ce3c0]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c0de19-df88-4175-a360-84d1b7c64382]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:39:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a96eee-85dc-436b-a71c-2fa3950244b9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260]
Aug 17 10:39:02 user nova-compute[73158]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9, portal: 172.16.0.220,3260] successful.
Aug 17 10:39:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a4f59d-4893-491d-8562-5fb68bc7ffb3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== disconnect_volume: return (278ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'flavor' on Instance uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1203e12b-ff12-46c3-b517-8ecbd66021a1 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.526s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:02 user nova-compute[73158]: INFO nova.compute.manager [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Terminating instance
Aug 17 10:39:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing instance network info cache due to event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:39:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-d306fc92-3649-4355-94cc-3bb2060b9b32 req-ce88c790-f9c0-4475-97bb-d68609ffc7f9 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-vif-unplugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d306fc92-3649-4355-94cc-3bb2060b9b32 req-ce88c790-f9c0-4475-97bb-d68609ffc7f9 service nova] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d306fc92-3649-4355-94cc-3bb2060b9b32 req-ce88c790-f9c0-4475-97bb-d68609ffc7f9 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d306fc92-3649-4355-94cc-3bb2060b9b32 req-ce88c790-f9c0-4475-97bb-d68609ffc7f9 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-d306fc92-3649-4355-94cc-3bb2060b9b32 req-ce88c790-f9c0-4475-97bb-d68609ffc7f9 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] No waiting events found dispatching network-vif-unplugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.compute.manager [req-d306fc92-3649-4355-94cc-3bb2060b9b32 req-ce88c790-f9c0-4475-97bb-d68609ffc7f9 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-vif-unplugged-73049b18-de64-48ac-996a-f2f7de305945 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Instance destroyed successfully.
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'resources' on Instance uuid 038be3bb-a7ec-49d0-80c6-8299d0d39e99 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-281920134',display_name='tempest-VolumesSnapshotTestJSON-instance-281920134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-281920134',id=40,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0VboslW3oH4t2TYcDhPldJGRn2yM8I3Z71yORiTUH+XTIlf6S98dl4RVjEGDPKL3qZyTrHAS0dKiEQczC7HKjXna4vQkxu2sfmDSPTXKcosKvcdG4ZnUknDp2T0v1paw==',key_name='tempest-keypair-2015717524',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4eabe57c34e5cb39756add1e33773',ramdisk_id='',reservation_id='r-m3i7i97c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1699436377',owner_user_name='tempest-VolumesSnapshotTestJSON-1699436377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='445ca2aa192a4bd38fbd59aacf99c673',uuid=038be3bb-a7ec-49d0-80c6-8299d0d39e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converting VIF {"id": "73049b18-de64-48ac-996a-f2f7de305945", "address": "fa:16:3e:f8:85:24", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73049b18-de", "ovs_interfaceid": "73049b18-de64-48ac-996a-f2f7de305945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_vif [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73049b18-de, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:03 user nova-compute[73158]: INFO os_vif [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:85:24,bridge_name='br-int',has_traffic_filtering=True,id=73049b18-de64-48ac-996a-f2f7de305945,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73049b18-de')
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZPeCuzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:39:03 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3eac5a-562f-44da-bbd2-c4dc859123c9', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af74354-4703-4059-a5a1-663f204bd265]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6262e-2232-4f4e-a139-5937fdbed389]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:39:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:39:03 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6f2b00>, {}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Disconnecting from: [] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== disconnect_volume: return (59ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:39:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Deleting instance files /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99_del
Aug 17 10:39:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Deletion of /opt/stack/data/nova/instances/038be3bb-a7ec-49d0-80c6-8299d0d39e99_del complete
Aug 17 10:39:03 user nova-compute[73158]: INFO nova.compute.manager [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 10:39:03 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:39:03 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:39:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updated VIF entry in instance network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:39:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6cf4fcf4-171b-4b7f-afe7-04e2fba3acec req-fe7c0681-bf22-4d20-b291-a33592bd3f3a service nova] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:04 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:04 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Took 0.96 seconds to deallocate network for instance.
Aug 17 10:39:04 user nova-compute[73158]: WARNING nova.volume.cinder [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Attachment 700d979e-c649-49c9-a0ce-4d0df39c3d1e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 700d979e-c649-49c9-a0ce-4d0df39c3d1e. (HTTP 404) (Request-ID: req-2511db8d-cb3f-4f40-a379-3e603887cc70)
Aug 17 10:39:04 user nova-compute[73158]: INFO nova.compute.manager [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Took 0.02 seconds to detach 1 volumes for instance.
Aug 17 10:39:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-d6bbdff2-fa6b-4207-8b0c-942cb95a8089 req-54ef2b2d-9859-4f52-ad3b-efba653d3a15 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-vif-deleted-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing instance network info cache due to event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:05 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Deleted allocations for instance 038be3bb-a7ec-49d0-80c6-8299d0d39e99
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1795e8b8-fef2-41b1-b5ef-75615da58c2e tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-7598c11b-b4fc-4b2a-904e-37e96213c93d req-499da85f-9c16-45b0-a1ec-b4a0f43ff6c3 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received event network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7598c11b-b4fc-4b2a-904e-37e96213c93d req-499da85f-9c16-45b0-a1ec-b4a0f43ff6c3 service nova] Acquiring lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7598c11b-b4fc-4b2a-904e-37e96213c93d req-499da85f-9c16-45b0-a1ec-b4a0f43ff6c3 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7598c11b-b4fc-4b2a-904e-37e96213c93d req-499da85f-9c16-45b0-a1ec-b4a0f43ff6c3 service nova] Lock "038be3bb-a7ec-49d0-80c6-8299d0d39e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-7598c11b-b4fc-4b2a-904e-37e96213c93d req-499da85f-9c16-45b0-a1ec-b4a0f43ff6c3 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] No waiting events found dispatching network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:39:05 user nova-compute[73158]: WARNING nova.compute.manager [req-7598c11b-b4fc-4b2a-904e-37e96213c93d req-499da85f-9c16-45b0-a1ec-b4a0f43ff6c3 service nova] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Received unexpected event network-vif-plugged-73049b18-de64-48ac-996a-f2f7de305945 for instance with vm_state deleted and task_state None.
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:05 user nova-compute[73158]: INFO nova.compute.manager [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Shelve offloading
Aug 17 10:39:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updated VIF entry in instance network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fc1913ed-86e8-4660-a934-3573dfc9b518 req-4339ebfb-8a89-4c4d-a060-61850af84b19 service nova] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance destroyed successfully.
Aug 17 10:39:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:39:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:39:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-unplugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-unplugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:39:07 user nova-compute[73158]: WARNING nova.compute.manager [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-unplugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state active and task_state shelving.
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:39:07 user nova-compute[73158]: WARNING nova.compute.manager [req-7a46e233-686c-4396-9266-05a7f507e45c req-eb41df7f-b49e-49d5-aa07-99db768a9e39 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state active and task_state shelving.
Aug 17 10:39:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance destroyed successfully.
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.objects.instance [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'resources' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-23641761',display_name='tempest-TestShelveInstance-server-23641761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-23641761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJt9oZogk+KTs0ars1cOwQiQCcCeDk5+7ckHbcMSgdZqjUvo4MFeDd8VIaxhvLn0HKtL+Kkuqp//H8+SFrxbct2KiBQP2VwF/OZ38kgZvZtJrxmBsxKfOB4TbtZHSWCA==',key_name='tempest-TestShelveInstance-797172059',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec52d227e61d40e38a321db08737f649',ramdisk_id='',reservation_id='r-1hlk3ygk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-357169844',owner_user_name='tempest-TestShelveInstance-357169844-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:37:30Z,user_data=None,user_id='eb9fa4a680274585a7a81ee20321f52b',uuid=fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converting VIF {"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_vif [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48f8ecc4-35, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing instance network info cache due to event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:39:07 user nova-compute[73158]: INFO os_vif [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35')
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:39:07 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ba8a3-be0c-4ecd-a4b2-e88a5c61a17a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eaf54a-7aec-4077-94a8-163526c09a46]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:39:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:39:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc70b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ef8f1-53ea-4f93-ba6c-23d3d1706da7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace9923-4cd3-438c-98e6-250571567555]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[57346606-b5f5-41f4-95cf-1fad7173c46e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4172c9-08dd-4a13-b4c5-6b30143fb083]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea30b917-545f-4c58-8c84-d8756679363b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4195c82a-173e-49bf-848d-4a66617041da]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]
Aug 17 10:39:07 user nova-compute[73158]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.
Aug 17 10:39:07 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0de44cb-b8b2-4ca1-8cc0-faa9fac9056c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] <== disconnect_volume: return (268ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:39:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Deleting instance files /opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f_del
Aug 17 10:39:07 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Deletion of /opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f_del complete
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updated VIF entry in instance network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": null, "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ee93bdbb-0ccb-44e9-bb12-4bd9a2992db8 req-883b7501-37aa-4833-b1e4-d0a78236e8f9 service nova] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:08 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Deleted allocations for instance fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f
Aug 17 10:39:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:08 user nova-compute[73158]: INFO nova.compute.manager [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Shelving
Aug 17 10:39:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG nova.objects.instance [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'numa_topology' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-f33261d7-bb6c-47f8-b8ac-7f999953e50c tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.550s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-5273e2a7-6678-49c8-9b2f-a6dd7a06d188 req-09666e2b-c3dc-4fd8-9636-b27e1bb52c46 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-unplugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5273e2a7-6678-49c8-9b2f-a6dd7a06d188 req-09666e2b-c3dc-4fd8-9636-b27e1bb52c46 service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5273e2a7-6678-49c8-9b2f-a6dd7a06d188 req-09666e2b-c3dc-4fd8-9636-b27e1bb52c46 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-5273e2a7-6678-49c8-9b2f-a6dd7a06d188 req-09666e2b-c3dc-4fd8-9636-b27e1bb52c46 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-5273e2a7-6678-49c8-9b2f-a6dd7a06d188 req-09666e2b-c3dc-4fd8-9636-b27e1bb52c46 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-unplugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:39:09 user nova-compute[73158]: WARNING nova.compute.manager [req-5273e2a7-6678-49c8-9b2f-a6dd7a06d188 req-09666e2b-c3dc-4fd8-9636-b27e1bb52c46 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-unplugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state active and task_state shelving.
Aug 17 10:39:09 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance destroyed successfully.
Aug 17 10:39:09 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Beginning cold snapshot process
Aug 17 10:39:09 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:39:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk /opt/stack/data/nova/instances/snapshots/tmp1v0erxqy/9915c96a008340149a4872fee15e0769 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk /opt/stack/data/nova/instances/snapshots/tmp1v0erxqy/9915c96a008340149a4872fee15e0769" returned: 0 in 0.620s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Snapshot extracted, beginning image upload
Aug 17 10:39:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-57ffe9c3-b288-45ad-83aa-bb1f31f81e5c req-3dfbff61-680a-4cff-8e76-f5560e6bc79b service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-57ffe9c3-b288-45ad-83aa-bb1f31f81e5c req-3dfbff61-680a-4cff-8e76-f5560e6bc79b service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-57ffe9c3-b288-45ad-83aa-bb1f31f81e5c req-3dfbff61-680a-4cff-8e76-f5560e6bc79b service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-57ffe9c3-b288-45ad-83aa-bb1f31f81e5c req-3dfbff61-680a-4cff-8e76-f5560e6bc79b service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-57ffe9c3-b288-45ad-83aa-bb1f31f81e5c req-3dfbff61-680a-4cff-8e76-f5560e6bc79b service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:39:11 user nova-compute[73158]: WARNING nova.compute.manager [req-57ffe9c3-b288-45ad-83aa-bb1f31f81e5c req-3dfbff61-680a-4cff-8e76-f5560e6bc79b service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 10:39:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Snapshot image upload complete
Aug 17 10:39:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:39:12 user nova-compute[73158]: INFO nova.compute.manager [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Shelve offloading
Aug 17 10:39:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance destroyed successfully.
Aug 17 10:39:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:39:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:39:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance destroyed successfully.
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'resources' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324139457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324139457',id=41,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnMfzOdZyb+byLQqZLSZVbvEC9w/CDMq3NcG69yGgNk4+kqpx8giB6xj6gtHmcfalSHP+T97uv92/6V7IA44lBa7MftMPtoCTyIQEWesv3TsuekzGLI1RsjZzeLwBcERA==',key_name='tempest-keypair-42577443',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-dx6jo9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member',shelved_at='2023-08-17T10:39:12.361085',shelved_host='user',shelved_image_id='cfcb0f97-f51e-4fe5-9ec2-6ce64910a496'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=8c6322c6-8362-4ed0-b0b3-0b948678a62e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG os_vif [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf18d69ba-69, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.compute.manager [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing instance network info cache due to event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.network.neutron [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:39:13 user nova-compute[73158]: INFO os_vif [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69')
Aug 17 10:39:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Deleting instance files /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e_del
Aug 17 10:39:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Deletion of /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e_del complete
Aug 17 10:39:13 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Deleted allocations for instance 8c6322c6-8362-4ed0-b0b3-0b948678a62e
Aug 17 10:39:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-591dcbf0-2530-4713-8db5-ea05677d377b tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.321s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updated VIF entry in instance network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:39:14 user nova-compute[73158]: DEBUG nova.network.neutron [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf18d69ba-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f2f245e2-6e82-4898-b363-5fb5ff64a9bd req-ea734956-1fd4-4abc-b415-b6628eb66a50 service nova] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:18 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268743.6639807, 038be3bb-a7ec-49d0-80c6-8299d0d39e99 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:39:18 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] VM Stopped (Lifecycle Event)
Aug 17 10:39:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5c04a12d-008c-4e87-ad4a-b36246169722 None None] [instance: 038be3bb-a7ec-49d0-80c6-8299d0d39e99] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:39:21 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268746.1339762, fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:39:21 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] VM Stopped (Lifecycle Event)
Aug 17 10:39:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cee691ab-a0ab-4077-a57f-525d54642eee None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:39:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:24 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268749.4299595, 8c6322c6-8362-4ed0-b0b3-0b948678a62e => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:39:24 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] VM Stopped (Lifecycle Event)
Aug 17 10:39:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d75764fe-8b44-4ce4-8c51-57c5074e438d None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:39:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:39:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:39:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:39:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:38 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:39:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:39:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:39:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:39:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating instance_info_cache with network_info: [{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:39:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:39:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:47 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:48 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:39:48 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8492MB free_disk=24.168720245361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c1d6d694-680c-45d0-9d4e-2c3d2217880e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:39:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-changed-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Refreshing instance network info cache due to event network-changed-a591b7b9-a8a6-4e89-9069-50ca84356268. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] Acquiring lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] Acquired lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Refreshing network info cache for port a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updated VIF entry in instance network info cache for port a591b7b9-a8a6-4e89-9069-50ca84356268. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating instance_info_cache with network_info: [{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e4c4ebcc-f873-4210-95f8-a86b2ffdfce6 req-234922c1-e2d3-46b4-84d5-b5cfe4bcd382 service nova] Releasing lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'flavor' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:39:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:39:51 user nova-compute[73158]: INFO nova.compute.manager [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attaching volume 6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 to /dev/vdb
Aug 17 10:39:51 user nova-compute[73158]: DEBUG os_brick.utils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b7a4ee-2cbf-494e-a2cd-b7cf15dcc509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[014dc87f-0870-420d-b578-99e4f52ff282]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cef3d5-c7d3-45ff-9f47-67108500eed2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83784473-5953-445e-b532-978f674b2c5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:39:51 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:39:51 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc30747-d87d-40bd-bac1-995469abba26]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG os_brick.utils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:39:51 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating existing volume attachment record: 256b23dc-2afa-46f9-9445-4b2ca4f9b479 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:39:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:39:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:39:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGuWZIrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:40:12 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:40:12 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:40:12 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a33249-2c03-4dd4-9140-6e6ee74166cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:40:12 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35647e-3145-4cf9-ae8a-42498a50a8f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2] added
Aug 17 10:40:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b100e68-782e-4ed9-a13e-241fbb41e1e8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce069c-de75-4076-8f63-1b5821358d37]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGuWZIrE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGuWZIrE" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36e22ce-cf7c-4de5-98e7-df71c30d6692]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGuWZIrE'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d53b1d0-e624-4a2c-b89e-a22e1c8f7f7e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd51ee-df93-47a9-a7be-76929f1a3ceb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:40:12 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:40:12 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:40:12 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:40:12 user nova-compute[73158]: 
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef220227-4f06-4356-aaf6-57964eb37c28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260]
Aug 17 10:40:12 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260] successful.
Aug 17 10:40:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1ce5b-a2d3-4e52-b064-911a3951203d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1c49d-2ed5-469b-bb85-b902672287c5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8454b2-f3b5-4c33-bbe2-e337a3f22bc4]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:40:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGuWZIrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:40:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:40:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23230656635643036', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:40:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230656635643036', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:40:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:13 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'flavor' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:40:13 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:40:13 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:40:13 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:40:13 user nova-compute[73158]:   <serial>6278af64-7ba9-4bd4-8dd7-9971ebb9afd2</serial>
Aug 17 10:40:13 user nova-compute[73158]: </disk>
Aug 17 10:40:13 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:40:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:40:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:40:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No VIF found with MAC fa:16:3e:26:5f:6c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:40:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9c09e71a-5062-4b69-aa5e-9dd8de059ab2 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.300s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:17 user nova-compute[73158]: DEBUG nova.objects.instance [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'flavor' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:18 user nova-compute[73158]: INFO nova.compute.manager [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attaching volume 71a78b39-528f-4d55-ad7a-36d2ea039c40 to /dev/vdc
Aug 17 10:40:18 user nova-compute[73158]: DEBUG os_brick.utils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[941fc168-c493-4457-b889-c553c82f5c86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e99f9c3-633e-46e3-bd6f-93c93bbc25e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[82611ce9-1a94-4f81-8522-1fa239c9ac55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e394525-ad66-4e63-b42a-ab66f38190c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:40:18 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:40:18 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60ee34a-1fcc-4d93-a969-1369550395b4]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG os_brick.utils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating existing volume attachment record: 48b1eed0-95be-495c-a17a-c45069e6c256 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:40:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:40:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNpBjPau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:40:38 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:40:38 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:40:38 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b3c86-c2d2-449c-996e-e5fc0ea62593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:40:38 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b069e21-ebf2-4787-820a-1de582ad21c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40] added
Aug 17 10:40:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4671e8e-e686-4965-bea3-f2d0ff6d7595]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c481a22-322e-45bd-993d-f4d9309258db]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNpBjPau {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNpBjPau" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c48f0b-cb89-4f59-b3f2-2f9a8f2306ce]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNpBjPau'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9467a91-94e2-4093-9ceb-2759f2762759]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6758f490-fd55-471a-94f0-0ce8dce6ac11]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51664ea2-85da-4d10-8391-38e42a90c7a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260]
Aug 17 10:40:38 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260] successful.
Aug 17 10:40:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aafdd5-8070-46ce-94ea-345c38354a56]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf80bb6-ebcf-442d-85c5-b8d38914b7f4]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:38 user nova-compute[73158]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 (non-flash)
Aug 17 10:40:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:38 user nova-compute[73158]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 (non-flash)
Aug 17 10:40:38 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0f29f1-5895-476b-b514-bd867a54e6de]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNpBjPau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:40:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:39 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:39 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:40:39 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26639653938346265', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:40:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639653938346265', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:40:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'flavor' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:39 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:40:39 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:40:39 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:40:39 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:40:39 user nova-compute[73158]:   <serial>71a78b39-528f-4d55-ad7a-36d2ea039c40</serial>
Aug 17 10:40:39 user nova-compute[73158]: </disk>
Aug 17 10:40:39 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] No VIF found with MAC fa:16:3e:26:5f:6c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-26fb115c-aa55-4036-841b-c7d134387b00 tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.988s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:40 user nova-compute[73158]: INFO nova.compute.manager [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Detaching volume 71a78b39-528f-4d55-ad7a-36d2ea039c40
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:40:40 user nova-compute[73158]: INFO nova.virt.block_device [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attempting to driver detach volume 71a78b39-528f-4d55-ad7a-36d2ea039c40 from mountpoint /dev/vdc
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Attempting to detach device vdc from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:40:40 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:40:40 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:40:40 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:40:40 user nova-compute[73158]:   <serial>71a78b39-528f-4d55-ad7a-36d2ea039c40</serial>
Aug 17 10:40:40 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 10:40:40 user nova-compute[73158]: </disk>
Aug 17 10:40:40 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:40:40 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Successfully detached device vdc from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the persistent domain config.
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:40:40 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:40:40 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:40:40 user nova-compute[73158]:   <target dev="vdc" bus="virtio"/>
Aug 17 10:40:40 user nova-compute[73158]:   <serial>71a78b39-528f-4d55-ad7a-36d2ea039c40</serial>
Aug 17 10:40:40 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 10:40:40 user nova-compute[73158]: </disk>
Aug 17 10:40:40 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:40 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:40:40 user nova-compute[73158]: INFO nova.compute.claims [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Claim successful on node user
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:40:41 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.policy [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '445ca2aa192a4bd38fbd59aacf99c673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4eabe57c34e5cb39756add1e33773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268841.3919308, c1d6d694-680c-45d0-9d4e-2c3d2217880e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:40:41 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Successfully detached device vdc from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the live domain config.
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:40:41 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Creating image(s)
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "/opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "/opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNpBjPau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:40:41 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6a8c8b-d49e-428c-bb11-92ea752b0f96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73730f-d2fd-4230-b27d-47343217140c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:41 user nova-compute[73158]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 (non-flash)
Aug 17 10:40:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:40:41 user nova-compute[73158]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 (non-flash)
Aug 17 10:40:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c4dbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487b577-b40b-4685-9ae6-c7a1dca2dd08]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[115f1cea-dd60-4b56-adcd-f2543267daf2]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5364af8b-ea47-45bc-aa72-ecc556c4a51f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb5449-79d7-46f6-9661-61dfde729a2b]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6d7e6b-ac12-4ebf-a1ea-23009d86e41d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db0009-89be-4d68-9954-3e7a703b2f27]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260]
Aug 17 10:40:41 user nova-compute[73158]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40, portal: 172.16.0.220,3260] successful.
Aug 17 10:40:41 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a78b39-528f-4d55-ad7a-36d2ea039c40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7d2ab6-4eb1-4121-8741-0c5550a52c80]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] <== disconnect_volume: return (373ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.192s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk 1073741824" returned: 0 in 0.063s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:41 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Successfully created port: 3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Cannot resize image /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'migration_context' on Instance uuid 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Ensure instance console log exists: /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.objects.instance [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'flavor' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-83131d31-58f2-4dba-9bc5-ca938d23620f tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.780s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:42 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Successfully updated port: 3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquired lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-changed-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.compute.manager [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Refreshing instance network info cache due to event network-changed-3d4d319e-f734-45a2-849d-6075eb9d9746. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] Acquiring lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updating instance_info_cache with network_info: [{"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Releasing lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Instance network_info: |[{"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] Acquired lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.neutron [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Refreshing network info cache for port 3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Start _get_guest_xml network_info=[{"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:40:43 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:40:43 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-411686339',display_name='tempest-VolumesSnapshotTestJSON-instance-411686339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-411686339',id=44,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAylgMcX5fBjahBX5NWS5zskmgDDZUWELQtHI7Nk2ImQQJMZSPtGiNH+5eN2Ti0Q1T8lVgj9ouIbnmJ5aqk9BqMjUzpHVGuAuY2ARiYDES47bxCMNj1LCAsVINF24R+pg==',key_name='tempest-keypair-1036952370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4eabe57c34e5cb39756add1e33773',ramdisk_id='',reservation_id='r-e0cuhtr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1699436377',owner_user_name='tempest-VolumesSnapshotTestJSON-1699436377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='445ca2aa192a4bd38fbd59aacf99c673',uuid=0dfe5e97-972e-47e4-b19d-ca51213f8bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converting VIF {"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:40:43 user nova-compute[73158]:   <uuid>0dfe5e97-972e-47e4-b19d-ca51213f8bf1</uuid>
Aug 17 10:40:43 user nova-compute[73158]:   <name>instance-0000002c</name>
Aug 17 10:40:43 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:40:43 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:40:43 user nova-compute[73158]:   <metadata>
Aug 17 10:40:43 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:40:43 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:40:43 user nova-compute[73158]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-411686339</nova:name>
Aug 17 10:40:43 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:40:43</nova:creationTime>
Aug 17 10:40:43 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:40:43 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:40:43 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:40:43 user nova-compute[73158]:       <nova:owner>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:user uuid="445ca2aa192a4bd38fbd59aacf99c673">tempest-VolumesSnapshotTestJSON-1699436377-project-member</nova:user>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:project uuid="99c4eabe57c34e5cb39756add1e33773">tempest-VolumesSnapshotTestJSON-1699436377</nova:project>
Aug 17 10:40:43 user nova-compute[73158]:       </nova:owner>
Aug 17 10:40:43 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:40:43 user nova-compute[73158]:       <nova:ports>
Aug 17 10:40:43 user nova-compute[73158]:         <nova:port uuid="3d4d319e-f734-45a2-849d-6075eb9d9746">
Aug 17 10:40:43 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 10:40:43 user nova-compute[73158]:         </nova:port>
Aug 17 10:40:43 user nova-compute[73158]:       </nova:ports>
Aug 17 10:40:43 user nova-compute[73158]:     </nova:instance>
Aug 17 10:40:43 user nova-compute[73158]:   </metadata>
Aug 17 10:40:43 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:40:43 user nova-compute[73158]:     <system>
Aug 17 10:40:43 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:40:43 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:40:43 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:40:43 user nova-compute[73158]:       <entry name="serial">0dfe5e97-972e-47e4-b19d-ca51213f8bf1</entry>
Aug 17 10:40:43 user nova-compute[73158]:       <entry name="uuid">0dfe5e97-972e-47e4-b19d-ca51213f8bf1</entry>
Aug 17 10:40:43 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:40:43 user nova-compute[73158]:     </system>
Aug 17 10:40:43 user nova-compute[73158]:   </sysinfo>
Aug 17 10:40:43 user nova-compute[73158]:   <os>
Aug 17 10:40:43 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:40:43 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:40:43 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:40:43 user nova-compute[73158]:   </os>
Aug 17 10:40:43 user nova-compute[73158]:   <features>
Aug 17 10:40:43 user nova-compute[73158]:     <acpi/>
Aug 17 10:40:43 user nova-compute[73158]:     <apic/>
Aug 17 10:40:43 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:40:43 user nova-compute[73158]:   </features>
Aug 17 10:40:43 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:40:43 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:40:43 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:40:43 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:40:43 user nova-compute[73158]:   </clock>
Aug 17 10:40:43 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:40:43 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:40:43 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:40:43 user nova-compute[73158]:   </cpu>
Aug 17 10:40:43 user nova-compute[73158]:   <devices>
Aug 17 10:40:43 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:40:43 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:40:43 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk"/>
Aug 17 10:40:43 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:40:43 user nova-compute[73158]:     </disk>
Aug 17 10:40:43 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:40:43 user nova-compute[73158]:       <mac address="fa:16:3e:c0:37:bb"/>
Aug 17 10:40:43 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:40:43 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:40:43 user nova-compute[73158]:       <target dev="tap3d4d319e-f7"/>
Aug 17 10:40:43 user nova-compute[73158]:     </interface>
Aug 17 10:40:43 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:40:43 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/console.log" append="off"/>
Aug 17 10:40:43 user nova-compute[73158]:     </serial>
Aug 17 10:40:43 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:40:43 user nova-compute[73158]:     <video>
Aug 17 10:40:43 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:40:43 user nova-compute[73158]:     </video>
Aug 17 10:40:43 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:40:43 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:40:43 user nova-compute[73158]:     </rng>
Aug 17 10:40:43 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:40:43 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:40:43 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:40:43 user nova-compute[73158]:     </memballoon>
Aug 17 10:40:43 user nova-compute[73158]:   </devices>
Aug 17 10:40:43 user nova-compute[73158]: </domain>
Aug 17 10:40:43 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-411686339',display_name='tempest-VolumesSnapshotTestJSON-instance-411686339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-411686339',id=44,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAylgMcX5fBjahBX5NWS5zskmgDDZUWELQtHI7Nk2ImQQJMZSPtGiNH+5eN2Ti0Q1T8lVgj9ouIbnmJ5aqk9BqMjUzpHVGuAuY2ARiYDES47bxCMNj1LCAsVINF24R+pg==',key_name='tempest-keypair-1036952370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4eabe57c34e5cb39756add1e33773',ramdisk_id='',reservation_id='r-e0cuhtr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1699436377',owner_user_name='tempest-VolumesSnapshotTestJSON-1699436377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='445ca2aa192a4bd38fbd59aacf99c673',uuid=0dfe5e97-972e-47e4-b19d-ca51213f8bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converting VIF {"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG os_vif [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d4d319e-f7, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d4d319e-f7, col_values=(('external_ids', {'iface-id': '3d4d319e-f734-45a2-849d-6075eb9d9746', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:37:bb', 'vm-uuid': '0dfe5e97-972e-47e4-b19d-ca51213f8bf1'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:43 user nova-compute[73158]: INFO os_vif [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7')
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:40:43 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No VIF found with MAC fa:16:3e:c0:37:bb, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.network.neutron [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updated VIF entry in instance network info cache for port 3d4d319e-f734-45a2-849d-6075eb9d9746. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.network.neutron [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updating instance_info_cache with network_info: [{"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6cc8c503-773d-4ce8-bde3-78149df9c28b req-9596f6e0-afb4-4ff2-8523-1742789a066b service nova] Releasing lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Skipping network cache update for instance because it is Building. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updating instance_info_cache with network_info: [{"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-30084e0f-ca18-4139-94ee-e470214e9b1a" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:40:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-2d17de74-07a2-419e-9f0b-5cabb2f217f8 req-8bf20e25-0923-4ed8-9261-e270d1228d66 service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d17de74-07a2-419e-9f0b-5cabb2f217f8 req-8bf20e25-0923-4ed8-9261-e270d1228d66 service nova] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d17de74-07a2-419e-9f0b-5cabb2f217f8 req-8bf20e25-0923-4ed8-9261-e270d1228d66 service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2d17de74-07a2-419e-9f0b-5cabb2f217f8 req-8bf20e25-0923-4ed8-9261-e270d1228d66 service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG nova.compute.manager [req-2d17de74-07a2-419e-9f0b-5cabb2f217f8 req-8bf20e25-0923-4ed8-9261-e270d1228d66 service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] No waiting events found dispatching network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:40:45 user nova-compute[73158]: WARNING nova.compute.manager [req-2d17de74-07a2-419e-9f0b-5cabb2f217f8 req-8bf20e25-0923-4ed8-9261-e270d1228d66 service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received unexpected event network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 for instance with vm_state building and task_state spawning.
Aug 17 10:40:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268847.0879874, 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] VM Resumed (Lifecycle Event)
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Instance spawned successfully.
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268847.089593, 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] VM Started (Lifecycle Event)
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0cd1e9e-57cf-4294-af5b-37910301ae60 req-36905633-1c0f-47e5-be25-4ff6fd95bb78 service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0cd1e9e-57cf-4294-af5b-37910301ae60 req-36905633-1c0f-47e5-be25-4ff6fd95bb78 service nova] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0cd1e9e-57cf-4294-af5b-37910301ae60 req-36905633-1c0f-47e5-be25-4ff6fd95bb78 service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0cd1e9e-57cf-4294-af5b-37910301ae60 req-36905633-1c0f-47e5-be25-4ff6fd95bb78 service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0cd1e9e-57cf-4294-af5b-37910301ae60 req-36905633-1c0f-47e5-be25-4ff6fd95bb78 service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] No waiting events found dispatching network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:40:47 user nova-compute[73158]: WARNING nova.compute.manager [req-f0cd1e9e-57cf-4294-af5b-37910301ae60 req-36905633-1c0f-47e5-be25-4ff6fd95bb78 service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received unexpected event network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 for instance with vm_state building and task_state spawning.
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 17 10:40:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:40:47 user nova-compute[73158]: INFO nova.compute.manager [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Took 6.34 seconds to build instance.
Aug 17 10:40:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a5e43fc8-ba84-4553-b71c-0dea76bd7765 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.443s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:51 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:40:51 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=24.165111541748047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 30084e0f-ca18-4139-94ee-e470214e9b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c1d6d694-680c-45d0-9d4e-2c3d2217880e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:40:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:40:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:40:57 user nova-compute[73158]: INFO nova.compute.manager [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Unshelving
Aug 17 10:40:57 user nova-compute[73158]: INFO nova.virt.block_device [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Booting with volume 95310979-dda4-4af8-bd92-9276fabc84d0 at /dev/vda
Aug 17 10:40:57 user nova-compute[73158]: DEBUG os_brick.utils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[98142eb0-9b72-4558-8f72-394017c8d15e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.063s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5a834a-ddf1-48f7-9997-fd3d7845cdd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d8180-7024-49c7-9e55-529ccb499052]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d46909-cdf5-465f-bb90-b124b945ae8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:40:57 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:40:57 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[173fae3e-cd78-4c2b-8335-2ad7a2950b4b]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG os_brick.utils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:40:57 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating existing volume attachment record: d4f6dcbb-fe91-4fe4-946d-733e8ebabb10 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:40:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:00 user nova-compute[73158]: INFO nova.compute.manager [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Terminating instance
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-4149f50c-5788-49ca-bea8-1622ded35121 req-2b1cca1a-b16c-4b78-a3c4-4a461529fcc2 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-vif-unplugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4149f50c-5788-49ca-bea8-1622ded35121 req-2b1cca1a-b16c-4b78-a3c4-4a461529fcc2 service nova] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4149f50c-5788-49ca-bea8-1622ded35121 req-2b1cca1a-b16c-4b78-a3c4-4a461529fcc2 service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4149f50c-5788-49ca-bea8-1622ded35121 req-2b1cca1a-b16c-4b78-a3c4-4a461529fcc2 service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-4149f50c-5788-49ca-bea8-1622ded35121 req-2b1cca1a-b16c-4b78-a3c4-4a461529fcc2 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] No waiting events found dispatching network-vif-unplugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-4149f50c-5788-49ca-bea8-1622ded35121 req-2b1cca1a-b16c-4b78-a3c4-4a461529fcc2 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-vif-unplugged-e2405fef-c32c-450b-ad59-6435c9f26231 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Instance destroyed successfully.
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lazy-loading 'resources' on Instance uuid 30084e0f-ca18-4139-94ee-e470214e9b1a {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1026638619',display_name='tempest-ServersNegativeTestJSON-server-1026638619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1026638619',id=38,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:32:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6ce46509014f69a037b59466497704',ramdisk_id='',reservation_id='r-x0k90pji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2112722000',owner_user_name='tempest-ServersNegativeTestJSON-2112722000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:32:09Z,user_data=None,user_id='499f77486ae9486990357d021d0a78cf',uuid=30084e0f-ca18-4139-94ee-e470214e9b1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converting VIF {"id": "e2405fef-c32c-450b-ad59-6435c9f26231", "address": "fa:16:3e:b8:07:b7", "network": {"id": "b3bbd347-0efb-44f4-9f92-e284c24f9da8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-364563297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6ce46509014f69a037b59466497704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2405fef-c3", "ovs_interfaceid": "e2405fef-c32c-450b-ad59-6435c9f26231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG os_vif [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2405fef-c3, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:41:00 user nova-compute[73158]: INFO os_vif [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:07:b7,bridge_name='br-int',has_traffic_filtering=True,id=e2405fef-c32c-450b-ad59-6435c9f26231,network=Network(b3bbd347-0efb-44f4-9f92-e284c24f9da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2405fef-c3')
Aug 17 10:41:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Deleting instance files /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a_del
Aug 17 10:41:00 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Deletion of /opt/stack/data/nova/instances/30084e0f-ca18-4139-94ee-e470214e9b1a_del complete
Aug 17 10:41:01 user nova-compute[73158]: INFO nova.compute.manager [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 10:41:01 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:41:01 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:41:01 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:41:01 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:41:01 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Took 0.60 seconds to deallocate network for instance.
Aug 17 10:41:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:01 user nova-compute[73158]: INFO nova.compute.manager [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Unshelving
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.080s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'pci_requests' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:02 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Deleted allocations for instance 30084e0f-ca18-4139-94ee-e470214e9b1a
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:41:02 user nova-compute[73158]: INFO nova.compute.claims [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Claim successful on node user
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-668de3c8-de03-45fe-81cc-94b2bd348d46 tempest-ServersNegativeTestJSON-2112722000 tempest-ServersNegativeTestJSON-2112722000-project-member] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:02 user nova-compute[73158]: INFO nova.network.neutron [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating port f18d69ba-6933-4c36-b759-9265fbf2bcc3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] Acquiring lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] Lock "30084e0f-ca18-4139-94ee-e470214e9b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] No waiting events found dispatching network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:41:02 user nova-compute[73158]: WARNING nova.compute.manager [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received unexpected event network-vif-plugged-e2405fef-c32c-450b-ad59-6435c9f26231 for instance with vm_state deleted and task_state None.
Aug 17 10:41:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-a7c8cd08-335b-40a0-8729-af67ea5e91ac req-e9af0551-f3b3-4d01-9201-538ba24f6aa5 service nova] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Received event network-vif-deleted-e2405fef-c32c-450b-ad59-6435c9f26231 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:41:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Creating image(s)
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "4d6dbf3c5bbd1e6830f3a749a0641c350d435308" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "4d6dbf3c5bbd1e6830f3a749a0641c350d435308" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.part --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing instance network info cache due to event network-changed-f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:41:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:41:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:41:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Refreshing network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.part --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG nova.virt.images [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] cfcb0f97-f51e-4fe5-9ec2-6ce64910a496 was qcow2, converting to raw {{(pid=73158) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG nova.privsep.utils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73158) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.part /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.converted {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.part /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.converted" returned: 0 in 0.267s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.converted --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updated VIF entry in instance network info cache for port f18d69ba-6933-4c36-b759-9265fbf2bcc3. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8b399a64-a114-4d38-b92d-1a4f27a7f435 req-4cc5f7aa-1d5a-4d64-a3b4-9ff77ee3d5a8 service nova] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "4d6dbf3c5bbd1e6830f3a749a0641c350d435308" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.829s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308 --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "4d6dbf3c5bbd1e6830f3a749a0641c350d435308" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "4d6dbf3c5bbd1e6830f3a749a0641c350d435308" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308 --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308,backing_fmt=raw /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308,backing_fmt=raw /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk 1073741824" returned: 0 in 0.056s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "4d6dbf3c5bbd1e6830f3a749a0641c350d435308" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:05 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308 --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308 --force-share --output=json" returned: 0 in 0.179s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:06 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'migration_context' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Rebasing disk image.
Aug 17 10:41:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc -F raw /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.objects.instance [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'pci_requests' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.objects.instance [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'numa_topology' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:41:08 user nova-compute[73158]: INFO nova.compute.claims [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Claim successful on node user
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc -F raw /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk" returned: 0 in 2.133s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Ensure instance console log exists: /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Start _get_guest_xml network_info=[{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='74a4de953e17fb12d2830f6062e585dc',container_format='bare',created_at=2023-08-17T10:39:09Z,direct_url=<?>,disk_format='qcow2',id=cfcb0f97-f51e-4fe5-9ec2-6ce64910a496,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-324139457-shelved',owner='26e64443813742dca6185cfd559df272',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T10:39:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:41:08 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:41:08 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='74a4de953e17fb12d2830f6062e585dc',container_format='bare',created_at=2023-08-17T10:39:09Z,direct_url=<?>,disk_format='qcow2',id=cfcb0f97-f51e-4fe5-9ec2-6ce64910a496,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-324139457-shelved',owner='26e64443813742dca6185cfd559df272',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T10:39:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324139457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324139457',id=41,image_ref='cfcb0f97-f51e-4fe5-9ec2-6ce64910a496',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-42577443',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-dx6jo9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member',shelved_at='2023-08-17T10:39:12.361085',shelved_host='user',shelved_image_id='cfcb0f97-f51e-4fe5-9ec2-6ce64910a496'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=8c6322c6-8362-4ed0-b0b3-0b948678a62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.objects.instance [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:41:08 user nova-compute[73158]:   <uuid>8c6322c6-8362-4ed0-b0b3-0b948678a62e</uuid>
Aug 17 10:41:08 user nova-compute[73158]:   <name>instance-00000029</name>
Aug 17 10:41:08 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:41:08 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:41:08 user nova-compute[73158]:   <metadata>
Aug 17 10:41:08 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:41:08 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:41:08 user nova-compute[73158]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-324139457</nova:name>
Aug 17 10:41:08 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:41:08</nova:creationTime>
Aug 17 10:41:08 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:41:08 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:41:08 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:41:08 user nova-compute[73158]:       <nova:owner>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:user uuid="cbf2fd52d7184d43aa53bf0d9b2afeca">tempest-AttachVolumeShelveTestJSON-1136258329-project-member</nova:user>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:project uuid="26e64443813742dca6185cfd559df272">tempest-AttachVolumeShelveTestJSON-1136258329</nova:project>
Aug 17 10:41:08 user nova-compute[73158]:       </nova:owner>
Aug 17 10:41:08 user nova-compute[73158]:       <nova:root type="image" uuid="cfcb0f97-f51e-4fe5-9ec2-6ce64910a496"/>
Aug 17 10:41:08 user nova-compute[73158]:       <nova:ports>
Aug 17 10:41:08 user nova-compute[73158]:         <nova:port uuid="f18d69ba-6933-4c36-b759-9265fbf2bcc3">
Aug 17 10:41:08 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 10:41:08 user nova-compute[73158]:         </nova:port>
Aug 17 10:41:08 user nova-compute[73158]:       </nova:ports>
Aug 17 10:41:08 user nova-compute[73158]:     </nova:instance>
Aug 17 10:41:08 user nova-compute[73158]:   </metadata>
Aug 17 10:41:08 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:41:08 user nova-compute[73158]:     <system>
Aug 17 10:41:08 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:41:08 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:41:08 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:41:08 user nova-compute[73158]:       <entry name="serial">8c6322c6-8362-4ed0-b0b3-0b948678a62e</entry>
Aug 17 10:41:08 user nova-compute[73158]:       <entry name="uuid">8c6322c6-8362-4ed0-b0b3-0b948678a62e</entry>
Aug 17 10:41:08 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:41:08 user nova-compute[73158]:     </system>
Aug 17 10:41:08 user nova-compute[73158]:   </sysinfo>
Aug 17 10:41:08 user nova-compute[73158]:   <os>
Aug 17 10:41:08 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:41:08 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:41:08 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:41:08 user nova-compute[73158]:   </os>
Aug 17 10:41:08 user nova-compute[73158]:   <features>
Aug 17 10:41:08 user nova-compute[73158]:     <acpi/>
Aug 17 10:41:08 user nova-compute[73158]:     <apic/>
Aug 17 10:41:08 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:41:08 user nova-compute[73158]:   </features>
Aug 17 10:41:08 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:41:08 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:41:08 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:41:08 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:41:08 user nova-compute[73158]:   </clock>
Aug 17 10:41:08 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:41:08 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:41:08 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:41:08 user nova-compute[73158]:   </cpu>
Aug 17 10:41:08 user nova-compute[73158]:   <devices>
Aug 17 10:41:08 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:41:08 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:41:08 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk"/>
Aug 17 10:41:08 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:41:08 user nova-compute[73158]:     </disk>
Aug 17 10:41:08 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:41:08 user nova-compute[73158]:       <mac address="fa:16:3e:ee:7f:61"/>
Aug 17 10:41:08 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:41:08 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:41:08 user nova-compute[73158]:       <target dev="tapf18d69ba-69"/>
Aug 17 10:41:08 user nova-compute[73158]:     </interface>
Aug 17 10:41:08 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:41:08 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/console.log" append="off"/>
Aug 17 10:41:08 user nova-compute[73158]:     </serial>
Aug 17 10:41:08 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:41:08 user nova-compute[73158]:     <video>
Aug 17 10:41:08 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:41:08 user nova-compute[73158]:     </video>
Aug 17 10:41:08 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:41:08 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:41:08 user nova-compute[73158]:     </rng>
Aug 17 10:41:08 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:41:08 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:41:08 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:41:08 user nova-compute[73158]:     </memballoon>
Aug 17 10:41:08 user nova-compute[73158]:   </devices>
Aug 17 10:41:08 user nova-compute[73158]: </domain>
Aug 17 10:41:08 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324139457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324139457',id=41,image_ref='cfcb0f97-f51e-4fe5-9ec2-6ce64910a496',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-42577443',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-dx6jo9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member',shelved_at='2023-08-17T10:39:12.361085',shelved_host='user',shelved_image_id='cfcb0f97-f51e-4fe5-9ec2-6ce64910a496'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=8c6322c6-8362-4ed0-b0b3-0b948678a62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG os_vif [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf18d69ba-69, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf18d69ba-69, col_values=(('external_ids', {'iface-id': 'f18d69ba-6933-4c36-b759-9265fbf2bcc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:7f:61', 'vm-uuid': '8c6322c6-8362-4ed0-b0b3-0b948678a62e'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:08 user nova-compute[73158]: INFO os_vif [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69')
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] No VIF found with MAC fa:16:3e:ee:7f:61, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:41:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:08 user nova-compute[73158]: INFO nova.network.neutron [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG nova.network.neutron [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing instance network info cache due to event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.network.neutron [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:41:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Creating image(s)
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Ensure instance console log exists: /opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Start _get_guest_xml network_info=[{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'd4f6dcbb-fe91-4fe4-946d-733e8ebabb10', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f', 'attached_at': '', 'detached_at': '', 'volume_id': '95310979-dda4-4af8-bd92-9276fabc84d0', 'serial': '95310979-dda4-4af8-bd92-9276fabc84d0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:41:10 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:41:10 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.objects.instance [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-19efca18-0c96-4eba-813f-98683aea0c33 req-243d207a-81cd-4fc7-9ed4-cf37398c0fe5 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-19efca18-0c96-4eba-813f-98683aea0c33 req-243d207a-81cd-4fc7-9ed4-cf37398c0fe5 service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-19efca18-0c96-4eba-813f-98683aea0c33 req-243d207a-81cd-4fc7-9ed4-cf37398c0fe5 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-19efca18-0c96-4eba-813f-98683aea0c33 req-243d207a-81cd-4fc7-9ed4-cf37398c0fe5 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-19efca18-0c96-4eba-813f-98683aea0c33 req-243d207a-81cd-4fc7-9ed4-cf37398c0fe5 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:41:10 user nova-compute[73158]: WARNING nova.compute.manager [req-19efca18-0c96-4eba-813f-98683aea0c33 req-243d207a-81cd-4fc7-9ed4-cf37398c0fe5 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:41:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:41:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:41:10 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff47ffa-d4a9-43fe-8bb6-23c97ca97a6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:41:10 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c5a971-00a4-42d4-96ae-da3e382b4d4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0] added
Aug 17 10:41:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[926ab1e5-a248-4da9-83f8-cf0ccb692473]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d652d-3ff5-4d91-b895-aac85d27f898]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNEnmUcL {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNEnmUcL" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219839f-1535-4fa3-a2c1-2124973b14e9]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNEnmUcL'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e18bb-f69c-4805-b78c-8b3ea274655c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296acd9-9479-4340-b063-aebf99c21848]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:41:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:41:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54c36e-22ff-496a-9788-9376e1c5e450]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]
Aug 17 10:41:10 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.
Aug 17 10:41:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed27624c-b71d-4fa4-8cf2-c00ef63b70fa]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b5de47-b673-416b-846b-19654b14e7ca]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:41:10 user nova-compute[73158]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:41:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:41:10 user nova-compute[73158]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:41:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a252e39-e394-4a08-af17-832cbf12148b]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updated VIF entry in instance network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:41:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7f55b85-85fd-4e8f-b9e3-41900725e8bd req-a4bb5846-fc12-4a77-b84b-c927d771a5d4 service nova] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26634383664313532', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634383664313532', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-23641761',display_name='tempest-TestShelveInstance-server-23641761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-23641761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-797172059',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ec52d227e61d40e38a321db08737f649',ramdisk_id='',reservation_id='r-1hlk3ygk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-357169844',owner_user_name='tempest-TestShelveInstance-357169844-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:40:57Z,user_data=None,user_id='eb9fa4a680274585a7a81ee20321f52b',uuid=fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converting VIF {"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'pci_devices' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:41:11 user nova-compute[73158]:   <uuid>fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f</uuid>
Aug 17 10:41:11 user nova-compute[73158]:   <name>instance-0000002a</name>
Aug 17 10:41:11 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:41:11 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:41:11 user nova-compute[73158]:   <metadata>
Aug 17 10:41:11 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:41:11 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:41:11 user nova-compute[73158]:       <nova:name>tempest-TestShelveInstance-server-23641761</nova:name>
Aug 17 10:41:11 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:41:10</nova:creationTime>
Aug 17 10:41:11 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:41:11 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:41:11 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:41:11 user nova-compute[73158]:       <nova:owner>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:user uuid="eb9fa4a680274585a7a81ee20321f52b">tempest-TestShelveInstance-357169844-project-member</nova:user>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:project uuid="ec52d227e61d40e38a321db08737f649">tempest-TestShelveInstance-357169844</nova:project>
Aug 17 10:41:11 user nova-compute[73158]:       </nova:owner>
Aug 17 10:41:11 user nova-compute[73158]:       <nova:ports>
Aug 17 10:41:11 user nova-compute[73158]:         <nova:port uuid="48f8ecc4-3585-4edc-9fef-b1db4e2335a5">
Aug 17 10:41:11 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 10:41:11 user nova-compute[73158]:         </nova:port>
Aug 17 10:41:11 user nova-compute[73158]:       </nova:ports>
Aug 17 10:41:11 user nova-compute[73158]:     </nova:instance>
Aug 17 10:41:11 user nova-compute[73158]:   </metadata>
Aug 17 10:41:11 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:41:11 user nova-compute[73158]:     <system>
Aug 17 10:41:11 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:41:11 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:41:11 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:41:11 user nova-compute[73158]:       <entry name="serial">fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f</entry>
Aug 17 10:41:11 user nova-compute[73158]:       <entry name="uuid">fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f</entry>
Aug 17 10:41:11 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:41:11 user nova-compute[73158]:     </system>
Aug 17 10:41:11 user nova-compute[73158]:   </sysinfo>
Aug 17 10:41:11 user nova-compute[73158]:   <os>
Aug 17 10:41:11 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:41:11 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:41:11 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:41:11 user nova-compute[73158]:   </os>
Aug 17 10:41:11 user nova-compute[73158]:   <features>
Aug 17 10:41:11 user nova-compute[73158]:     <acpi/>
Aug 17 10:41:11 user nova-compute[73158]:     <apic/>
Aug 17 10:41:11 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:41:11 user nova-compute[73158]:   </features>
Aug 17 10:41:11 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:41:11 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:41:11 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:41:11 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:41:11 user nova-compute[73158]:   </clock>
Aug 17 10:41:11 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:41:11 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:41:11 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:41:11 user nova-compute[73158]:   </cpu>
Aug 17 10:41:11 user nova-compute[73158]:   <devices>
Aug 17 10:41:11 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:41:11 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:41:11 user nova-compute[73158]:       <source dev="/dev/sdc"/>
Aug 17 10:41:11 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:41:11 user nova-compute[73158]:       <serial>95310979-dda4-4af8-bd92-9276fabc84d0</serial>
Aug 17 10:41:11 user nova-compute[73158]:     </disk>
Aug 17 10:41:11 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:41:11 user nova-compute[73158]:       <mac address="fa:16:3e:86:b3:88"/>
Aug 17 10:41:11 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:41:11 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:41:11 user nova-compute[73158]:       <target dev="tap48f8ecc4-35"/>
Aug 17 10:41:11 user nova-compute[73158]:     </interface>
Aug 17 10:41:11 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:41:11 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f/console.log" append="off"/>
Aug 17 10:41:11 user nova-compute[73158]:     </serial>
Aug 17 10:41:11 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:41:11 user nova-compute[73158]:     <video>
Aug 17 10:41:11 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:41:11 user nova-compute[73158]:     </video>
Aug 17 10:41:11 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:41:11 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:41:11 user nova-compute[73158]:     </rng>
Aug 17 10:41:11 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:41:11 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:41:11 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:41:11 user nova-compute[73158]:     </memballoon>
Aug 17 10:41:11 user nova-compute[73158]:   </devices>
Aug 17 10:41:11 user nova-compute[73158]: </domain>
Aug 17 10:41:11 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-23641761',display_name='tempest-TestShelveInstance-server-23641761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-23641761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-797172059',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ec52d227e61d40e38a321db08737f649',ramdisk_id='',reservation_id='r-1hlk3ygk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-357169844',owner_user_name='tempest-TestShelveInstance-357169844-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:40:57Z,user_data=None,user_id='eb9fa4a680274585a7a81ee20321f52b',uuid=fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converting VIF {"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG os_vif [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48f8ecc4-35, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48f8ecc4-35, col_values=(('external_ids', {'iface-id': '48f8ecc4-3585-4edc-9fef-b1db4e2335a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:b3:88', 'vm-uuid': 'fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:11 user nova-compute[73158]: INFO os_vif [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35')
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:41:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] No VIF found with MAC fa:16:3e:86:b3:88, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-e92bcdaa-110c-48b7-9707-c2f51e28f0e5 req-6ad05ed0-b742-4cb0-b91a-3c24077477a7 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e92bcdaa-110c-48b7-9707-c2f51e28f0e5 req-6ad05ed0-b742-4cb0-b91a-3c24077477a7 service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e92bcdaa-110c-48b7-9707-c2f51e28f0e5 req-6ad05ed0-b742-4cb0-b91a-3c24077477a7 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e92bcdaa-110c-48b7-9707-c2f51e28f0e5 req-6ad05ed0-b742-4cb0-b91a-3c24077477a7 service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-e92bcdaa-110c-48b7-9707-c2f51e28f0e5 req-6ad05ed0-b742-4cb0-b91a-3c24077477a7 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:41:12 user nova-compute[73158]: WARNING nova.compute.manager [req-e92bcdaa-110c-48b7-9707-c2f51e28f0e5 req-6ad05ed0-b742-4cb0-b91a-3c24077477a7 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268872.1932776, 8c6322c6-8362-4ed0-b0b3-0b948678a62e => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:41:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] VM Resumed (Lifecycle Event)
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:41:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance spawned successfully.
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:41:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268872.19932, 8c6322c6-8362-4ed0-b0b3-0b948678a62e => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:41:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] VM Started (Lifecycle Event)
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:41:12 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:41:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-ef97cc6f-ec56-4408-b5d7-14b40590d132 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.607s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:41:14 user nova-compute[73158]: WARNING nova.compute.manager [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 10:41:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:41:14 user nova-compute[73158]: WARNING nova.compute.manager [req-d02d9d50-9353-4d11-a201-4f45b2fd5260 req-e6814749-a257-4b4e-ba42-92193f1200a4 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268875.4095135, fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:41:15 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] VM Resumed (Lifecycle Event)
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:41:15 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance spawned successfully.
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:41:15 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268875.4156787, fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:41:15 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] VM Started (Lifecycle Event)
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:41:15 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:41:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-048be150-245f-4be1-b4ec-f34df4a2fb05 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.402s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268860.916493, 30084e0f-ca18-4139-94ee-e470214e9b1a => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:41:15 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] VM Stopped (Lifecycle Event)
Aug 17 10:41:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-501f13a5-394d-4b0f-9f4e-2c27fe930a78 None None] [instance: 30084e0f-ca18-4139-94ee-e470214e9b1a] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:41:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:31 user nova-compute[73158]: INFO nova.compute.manager [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Detaching volume 6278af64-7ba9-4bd4-8dd7-9971ebb9afd2
Aug 17 10:41:31 user nova-compute[73158]: INFO nova.virt.block_device [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Attempting to driver detach volume 6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 from mountpoint /dev/vdb
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Attempting to detach device vdb from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:41:31 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:41:31 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:41:31 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:41:31 user nova-compute[73158]:   <serial>6278af64-7ba9-4bd4-8dd7-9971ebb9afd2</serial>
Aug 17 10:41:31 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:41:31 user nova-compute[73158]: </disk>
Aug 17 10:41:31 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:41:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Successfully detached device vdb from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the persistent domain config.
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:41:31 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:41:31 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:41:31 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:41:31 user nova-compute[73158]:   <serial>6278af64-7ba9-4bd4-8dd7-9971ebb9afd2</serial>
Aug 17 10:41:31 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:41:31 user nova-compute[73158]: </disk>
Aug 17 10:41:31 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692268891.9264445, c1d6d694-680c-45d0-9d4e-2c3d2217880e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:41:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Successfully detached device vdb from instance c1d6d694-680c-45d0-9d4e-2c3d2217880e from the live domain config.
Aug 17 10:41:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGuWZIrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:41:31 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb556fe-dc40-48ec-b38f-ef03cb3a9d8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[684548a7-10a7-4909-a5b1-b2b5995539b7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:41:31 user nova-compute[73158]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:41:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 (non-flash)
Aug 17 10:41:31 user nova-compute[73158]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:41:31 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:41:31 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d28320-c949-4fd4-898c-a77e6dbb2f67]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a1b209-6d3c-44b6-8c47-468e9a8bbdae]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[542b4cd3-e51b-4054-b24f-e33c72bfd607]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb6d4d-9da1-43c1-9dbf-e7cdcda0af6c]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7958c3-db73-4cf5-ab06-81420502070c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb3190-7d41-424d-8ca5-6573b2cfcf2c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260]
Aug 17 10:41:32 user nova-compute[73158]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2, portal: 172.16.0.220,3260] successful.
Aug 17 10:41:32 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6278af64-7ba9-4bd4-8dd7-9971ebb9afd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbccb0d-097e-4a53-ab80-2a8f85992bb4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] <== disconnect_volume: return (273ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:32 user nova-compute[73158]: DEBUG nova.objects.instance [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'flavor' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:41:33 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-22dcb69a-4d87-4ee5-bf05-1b535ac87a5d tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:44 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:41:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:41:44 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:41:44 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:41:45 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating instance_info_cache with network_info: [{"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:41:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-c1d6d694-680c-45d0-9d4e-2c3d2217880e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:41:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:41:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:41:48 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:41:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:41:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:52 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:41:52 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8201MB free_disk=24.129627227783203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance c1d6d694-680c-45d0-9d4e-2c3d2217880e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8c6322c6-8362-4ed0-b0b3-0b948678a62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:41:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:41:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:41:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:42:17 user nova-compute[73158]: INFO nova.compute.claims [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Claim successful on node user
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:42:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:42:17 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Creating image(s)
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "/opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "/opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "/opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG nova.policy [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5637661c3d2046ffb53dbdb91d290a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21fd98665d7b496ba078b65d7f9f5565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.198s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:17 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.251s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk 1073741824" returned: 0 in 0.060s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.201s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Successfully created port: 07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Cannot resize image /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lazy-loading 'migration_context' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Ensure instance console log exists: /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Successfully updated port: 07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquired lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-changed-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Refreshing instance network info cache due to event network-changed-07b0f879-1e82-4ac7-bb47-d41316b01f85. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] Acquiring lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating instance_info_cache with network_info: [{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Releasing lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Instance network_info: |[{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] Acquired lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.neutron [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Refreshing network info cache for port 07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Start _get_guest_xml network_info=[{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:42:19 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:42:19 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2288714',id=45,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQoh7LcnMnPRCdV8d9S4RDMhB6XU1ogKSQhGuUYAVh9Gy0J9eYABCjA4u8gx6X/6XZrOjYWKPVZ2yDKyBAm0aEjb2twcr6QPqLLNPng6uuxtIdf21pSzwP1WYA3s+q9hg==',key_name='tempest-keypair-1845836502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21fd98665d7b496ba078b65d7f9f5565',ramdisk_id='',reservation_id='r-r4vzh9e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2124696365',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5637661c3d2046ffb53dbdb91d290a53',uuid=7170e6d3-7c52-4170-97e4-2a0057c2f084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Converting VIF {"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.objects.instance [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lazy-loading 'pci_devices' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:42:19 user nova-compute[73158]:   <uuid>7170e6d3-7c52-4170-97e4-2a0057c2f084</uuid>
Aug 17 10:42:19 user nova-compute[73158]:   <name>instance-0000002d</name>
Aug 17 10:42:19 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:42:19 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:42:19 user nova-compute[73158]:   <metadata>
Aug 17 10:42:19 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:42:19 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:42:19 user nova-compute[73158]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410</nova:name>
Aug 17 10:42:19 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:42:19</nova:creationTime>
Aug 17 10:42:19 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:42:19 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:42:19 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:42:19 user nova-compute[73158]:       <nova:owner>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:user uuid="5637661c3d2046ffb53dbdb91d290a53">tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member</nova:user>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:project uuid="21fd98665d7b496ba078b65d7f9f5565">tempest-TestServerVolumeAttachScenarioOldVersion-2124696365</nova:project>
Aug 17 10:42:19 user nova-compute[73158]:       </nova:owner>
Aug 17 10:42:19 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:42:19 user nova-compute[73158]:       <nova:ports>
Aug 17 10:42:19 user nova-compute[73158]:         <nova:port uuid="07b0f879-1e82-4ac7-bb47-d41316b01f85">
Aug 17 10:42:19 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 10:42:19 user nova-compute[73158]:         </nova:port>
Aug 17 10:42:19 user nova-compute[73158]:       </nova:ports>
Aug 17 10:42:19 user nova-compute[73158]:     </nova:instance>
Aug 17 10:42:19 user nova-compute[73158]:   </metadata>
Aug 17 10:42:19 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:42:19 user nova-compute[73158]:     <system>
Aug 17 10:42:19 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:42:19 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:42:19 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:42:19 user nova-compute[73158]:       <entry name="serial">7170e6d3-7c52-4170-97e4-2a0057c2f084</entry>
Aug 17 10:42:19 user nova-compute[73158]:       <entry name="uuid">7170e6d3-7c52-4170-97e4-2a0057c2f084</entry>
Aug 17 10:42:19 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:42:19 user nova-compute[73158]:     </system>
Aug 17 10:42:19 user nova-compute[73158]:   </sysinfo>
Aug 17 10:42:19 user nova-compute[73158]:   <os>
Aug 17 10:42:19 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:42:19 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:42:19 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:42:19 user nova-compute[73158]:   </os>
Aug 17 10:42:19 user nova-compute[73158]:   <features>
Aug 17 10:42:19 user nova-compute[73158]:     <acpi/>
Aug 17 10:42:19 user nova-compute[73158]:     <apic/>
Aug 17 10:42:19 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:42:19 user nova-compute[73158]:   </features>
Aug 17 10:42:19 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:42:19 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:42:19 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:42:19 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:42:19 user nova-compute[73158]:   </clock>
Aug 17 10:42:19 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:42:19 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:42:19 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:42:19 user nova-compute[73158]:   </cpu>
Aug 17 10:42:19 user nova-compute[73158]:   <devices>
Aug 17 10:42:19 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:42:19 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:42:19 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk"/>
Aug 17 10:42:19 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:42:19 user nova-compute[73158]:     </disk>
Aug 17 10:42:19 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:42:19 user nova-compute[73158]:       <mac address="fa:16:3e:a9:46:7c"/>
Aug 17 10:42:19 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:42:19 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:42:19 user nova-compute[73158]:       <target dev="tap07b0f879-1e"/>
Aug 17 10:42:19 user nova-compute[73158]:     </interface>
Aug 17 10:42:19 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:42:19 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/console.log" append="off"/>
Aug 17 10:42:19 user nova-compute[73158]:     </serial>
Aug 17 10:42:19 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:42:19 user nova-compute[73158]:     <video>
Aug 17 10:42:19 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:42:19 user nova-compute[73158]:     </video>
Aug 17 10:42:19 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:42:19 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:42:19 user nova-compute[73158]:     </rng>
Aug 17 10:42:19 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:42:19 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:42:19 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:42:19 user nova-compute[73158]:     </memballoon>
Aug 17 10:42:19 user nova-compute[73158]:   </devices>
Aug 17 10:42:19 user nova-compute[73158]: </domain>
Aug 17 10:42:19 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2288714',id=45,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQoh7LcnMnPRCdV8d9S4RDMhB6XU1ogKSQhGuUYAVh9Gy0J9eYABCjA4u8gx6X/6XZrOjYWKPVZ2yDKyBAm0aEjb2twcr6QPqLLNPng6uuxtIdf21pSzwP1WYA3s+q9hg==',key_name='tempest-keypair-1845836502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21fd98665d7b496ba078b65d7f9f5565',ramdisk_id='',reservation_id='r-r4vzh9e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2124696365',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5637661c3d2046ffb53dbdb91d290a53',uuid=7170e6d3-7c52-4170-97e4-2a0057c2f084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Converting VIF {"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG os_vif [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07b0f879-1e, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07b0f879-1e, col_values=(('external_ids', {'iface-id': '07b0f879-1e82-4ac7-bb47-d41316b01f85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:46:7c', 'vm-uuid': '7170e6d3-7c52-4170-97e4-2a0057c2f084'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:19 user nova-compute[73158]: INFO os_vif [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e')
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:42:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] No VIF found with MAC fa:16:3e:a9:46:7c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:42:20 user nova-compute[73158]: DEBUG nova.network.neutron [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updated VIF entry in instance network info cache for port 07b0f879-1e82-4ac7-bb47-d41316b01f85. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:42:20 user nova-compute[73158]: DEBUG nova.network.neutron [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating instance_info_cache with network_info: [{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-fa41af64-70e5-4f52-ba39-d1e222d6d88c req-08670a24-4d5f-4c10-bde9-f397d09ef8d8 service nova] Releasing lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-b0fca3c6-31b7-46b8-a1fd-4b1f9c33a632 req-37c67cb7-0b4a-4ef5-ad47-e784545730ce service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b0fca3c6-31b7-46b8-a1fd-4b1f9c33a632 req-37c67cb7-0b4a-4ef5-ad47-e784545730ce service nova] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b0fca3c6-31b7-46b8-a1fd-4b1f9c33a632 req-37c67cb7-0b4a-4ef5-ad47-e784545730ce service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b0fca3c6-31b7-46b8-a1fd-4b1f9c33a632 req-37c67cb7-0b4a-4ef5-ad47-e784545730ce service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-b0fca3c6-31b7-46b8-a1fd-4b1f9c33a632 req-37c67cb7-0b4a-4ef5-ad47-e784545730ce service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] No waiting events found dispatching network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:21 user nova-compute[73158]: WARNING nova.compute.manager [req-b0fca3c6-31b7-46b8-a1fd-4b1f9c33a632 req-37c67cb7-0b4a-4ef5-ad47-e784545730ce service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received unexpected event network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 for instance with vm_state building and task_state spawning.
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:21 user nova-compute[73158]: INFO nova.compute.manager [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Terminating instance
Aug 17 10:42:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:42:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Instance destroyed successfully.
Aug 17 10:42:22 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lazy-loading 'resources' on Instance uuid c1d6d694-680c-45d0-9d4e-2c3d2217880e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1110044070',display_name='tempest-TestServerVolumeAttachmentScenario-server-1110044070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1110044070',id=43,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6Ln3MEutJdeQ+D1Kar90cahgmDPwatOpDJ6EWgmUq93VeKxcEgQll3GLQdcTahAQN7zHflB2vhXVI0eCu7WKD+TFWx56AlBQMsQgxrBke94C6ID7zp44iDEOLbCESyyQ==',key_name='tempest-keypair-889200883',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b94f96ada7624645a1ae4cf6b9d93c83',ramdisk_id='',reservation_id='r-j7fbm06q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1057603411',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1057603411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:38:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da6612da12d4678a8959dbe165ccf63',uuid=c1d6d694-680c-45d0-9d4e-2c3d2217880e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Converting VIF {"id": "a591b7b9-a8a6-4e89-9069-50ca84356268", "address": "fa:16:3e:26:5f:6c", "network": {"id": "0f917842-40ea-4500-b165-7ecbb504134f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1547485539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94f96ada7624645a1ae4cf6b9d93c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa591b7b9-a8", "ovs_interfaceid": "a591b7b9-a8a6-4e89-9069-50ca84356268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG os_vif [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa591b7b9-a8, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:22 user nova-compute[73158]: INFO os_vif [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:5f:6c,bridge_name='br-int',has_traffic_filtering=True,id=a591b7b9-a8a6-4e89-9069-50ca84356268,network=Network(0f917842-40ea-4500-b165-7ecbb504134f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa591b7b9-a8')
Aug 17 10:42:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Deleting instance files /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e_del
Aug 17 10:42:22 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Deletion of /opt/stack/data/nova/instances/c1d6d694-680c-45d0-9d4e-2c3d2217880e_del complete
Aug 17 10:42:22 user nova-compute[73158]: INFO nova.compute.manager [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 10:42:22 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:42:22 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268943.3751233, 7170e6d3-7c52-4170-97e4-2a0057c2f084 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] VM Resumed (Lifecycle Event)
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Instance spawned successfully.
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692268943.376882, 7170e6d3-7c52-4170-97e4-2a0057c2f084 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] VM Started (Lifecycle Event)
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] No waiting events found dispatching network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:23 user nova-compute[73158]: WARNING nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received unexpected event network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 for instance with vm_state building and task_state spawning.
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-unplugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-unplugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-unplugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:23 user nova-compute[73158]: WARNING nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state active and task_state deleting.
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:23 user nova-compute[73158]: DEBUG nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:23 user nova-compute[73158]: WARNING nova.compute.manager [req-f0ea168b-ea6e-49b2-ae42-a73124155b9c req-8ceb1e5d-e327-4a12-b06e-4e5330627827 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state active and task_state deleting.
Aug 17 10:42:23 user nova-compute[73158]: INFO nova.compute.manager [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Took 6.55 seconds to build instance.
Aug 17 10:42:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-a4538010-f2b6-41f9-a054-150a4f311d3e tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.645s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:24 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:24 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Took 1.74 seconds to deallocate network for instance.
Aug 17 10:42:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:24 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:42:24 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:42:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:24 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Deleted allocations for instance c1d6d694-680c-45d0-9d4e-2c3d2217880e
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0bbcbf9b-863e-4c9d-bffc-8e10e63e45ee tempest-TestServerVolumeAttachmentScenario-1057603411 tempest-TestServerVolumeAttachmentScenario-1057603411-project-member] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.141s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:25 user nova-compute[73158]: WARNING nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state deleted and task_state None.
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-unplugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-unplugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:25 user nova-compute[73158]: WARNING nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-unplugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state deleted and task_state None.
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Acquiring lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] Lock "c1d6d694-680c-45d0-9d4e-2c3d2217880e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] No waiting events found dispatching network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:25 user nova-compute[73158]: WARNING nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received unexpected event network-vif-plugged-a591b7b9-a8a6-4e89-9069-50ca84356268 for instance with vm_state deleted and task_state None.
Aug 17 10:42:25 user nova-compute[73158]: DEBUG nova.compute.manager [req-6fdcb757-6b6b-44ff-9bcb-e9b478b54cca req-06f27185-92b7-4651-8675-7c7bd3963581 service nova] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Received event network-vif-deleted-a591b7b9-a8a6-4e89-9069-50ca84356268 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:31 user nova-compute[73158]: DEBUG nova.compute.manager [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-changed-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:31 user nova-compute[73158]: DEBUG nova.compute.manager [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Refreshing instance network info cache due to event network-changed-3d4d319e-f734-45a2-849d-6075eb9d9746. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:42:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] Acquiring lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:42:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] Acquired lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:42:31 user nova-compute[73158]: DEBUG nova.network.neutron [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Refreshing network info cache for port 3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'flavor' on Instance uuid 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:32 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Ignoring supplied device name: /dev/vdb
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:32 user nova-compute[73158]: INFO nova.compute.manager [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Attaching volume b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 to /dev/vdb
Aug 17 10:42:32 user nova-compute[73158]: DEBUG os_brick.utils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c76d96-00f1-46a7-98be-91acec4553e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG nova.network.neutron [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updated VIF entry in instance network info cache for port 3d4d319e-f734-45a2-849d-6075eb9d9746. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG nova.network.neutron [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updating instance_info_cache with network_info: [{"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f153e6-41a1-414a-9be9-6c6bcbe3825d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-669b4db6-183c-47e3-9aa7-16319fc19500 req-b70ab7d8-022a-4b35-96fd-a9b2e439289b service nova] Releasing lock "refresh_cache-0dfe5e97-972e-47e4-b19d-ca51213f8bf1" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02cdd3b-0159-4d20-a38c-7124a2a5d72d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6ca70-ea73-4b47-8eb4-1a1554984013]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:42:32 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:42:32 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d558f2a0-db8e-4728-85c9-81b6a6020544]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG os_brick.utils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updating existing volume attachment record: 07be4923-58ac-4f5e-bbed-c94af4ca7462 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:42:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:37 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268942.6928246, c1d6d694-680c-45d0-9d4e-2c3d2217880e => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:42:37 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] VM Stopped (Lifecycle Event)
Aug 17 10:42:37 user nova-compute[73158]: DEBUG nova.compute.manager [None req-180931b8-50bb-4bb2-84a7-a5226949a41a None None] [instance: c1d6d694-680c-45d0-9d4e-2c3d2217880e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:42:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:42 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:45 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [{"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-8c6322c6-8362-4ed0-b0b3-0b948678a62e" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:42:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:42:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing instance network info cache due to event network-changed-48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] Acquiring lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] Acquired lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.network.neutron [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Refreshing network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:48 user nova-compute[73158]: INFO nova.compute.manager [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Terminating instance
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-c9677c65-0819-4d77-b7e3-f88c66bbae82 req-2c840ac1-2e98-4dcd-b4c5-5b3ab82e7ec2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-unplugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c9677c65-0819-4d77-b7e3-f88c66bbae82 req-2c840ac1-2e98-4dcd-b4c5-5b3ab82e7ec2 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c9677c65-0819-4d77-b7e3-f88c66bbae82 req-2c840ac1-2e98-4dcd-b4c5-5b3ab82e7ec2 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c9677c65-0819-4d77-b7e3-f88c66bbae82 req-2c840ac1-2e98-4dcd-b4c5-5b3ab82e7ec2 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-c9677c65-0819-4d77-b7e3-f88c66bbae82 req-2c840ac1-2e98-4dcd-b4c5-5b3ab82e7ec2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-unplugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.compute.manager [req-c9677c65-0819-4d77-b7e3-f88c66bbae82 req-2c840ac1-2e98-4dcd-b4c5-5b3ab82e7ec2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-unplugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.network.neutron [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updated VIF entry in instance network info cache for port 48f8ecc4-3585-4edc-9fef-b1db4e2335a5. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.network.neutron [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [{"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-73d7dd14-81eb-42c8-8b05-3347255e0f77 req-3048f480-b079-4a92-8536-3f7794320d06 service nova] Releasing lock "refresh_cache-fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:42:48 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Instance destroyed successfully.
Aug 17 10:42:48 user nova-compute[73158]: DEBUG nova.objects.instance [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lazy-loading 'resources' on Instance uuid fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-23641761',display_name='tempest-TestShelveInstance-server-23641761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-23641761',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJt9oZogk+KTs0ars1cOwQiQCcCeDk5+7ckHbcMSgdZqjUvo4MFeDd8VIaxhvLn0HKtL+Kkuqp//H8+SFrxbct2KiBQP2VwF/OZ38kgZvZtJrxmBsxKfOB4TbtZHSWCA==',key_name='tempest-TestShelveInstance-797172059',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec52d227e61d40e38a321db08737f649',ramdisk_id='',reservation_id='r-1hlk3ygk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-357169844',owner_user_name='tempest-TestShelveInstance-357169844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:41:15Z,user_data=None,user_id='eb9fa4a680274585a7a81ee20321f52b',uuid=fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converting VIF {"id": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "address": "fa:16:3e:86:b3:88", "network": {"id": "09a6e219-5f75-4442-bb0b-26658bc69d12", "bridge": "br-int", "label": "tempest-TestShelveInstance-147602338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec52d227e61d40e38a321db08737f649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f8ecc4-35", "ovs_interfaceid": "48f8ecc4-3585-4edc-9fef-b1db4e2335a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_vif [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48f8ecc4-35, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:42:49 user nova-compute[73158]: INFO os_vif [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b3:88,bridge_name='br-int',has_traffic_filtering=True,id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5,network=Network(09a6e219-5f75-4442-bb0b-26658bc69d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f8ecc4-35')
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNEnmUcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:42:49 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b716c62-f990-404f-8bb5-5c39ebbbcea8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af16cf4-c697-43ea-8661-7fa1cce713ac]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 (non-flash)
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6f0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXJerLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:42:49 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe000b-f92a-4fb1-b73b-9c4d87c8ab03]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e6a50-490b-4629-9802-0b44f8d3e350]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c69d23a-5c3a-487f-b02e-6689f10e4da5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[059e0267-d15a-4021-8ee7-815851b0bd23]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26634383664313532', '/dev/disk/by-id/scsi-1SCST_BIO9b4b8a16-f486d152ac1bbf77', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9b4b8a16') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac31278-f197-4f02-8e40-d52dd0287292]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcebd37-944c-4879-b4e3-aca2bc873d39]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6393c510-8b7b-49ba-b022-77ef660f08a5]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260]
Aug 17 10:42:49 user nova-compute[73158]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0, portal: 172.16.0.220,3260] successful.
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95310979-dda4-4af8-bd92-9276fabc84d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea733f45-3c0d-4d65-bb76-c9fbcae37f2d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] <== disconnect_volume: return (278ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:42:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Deleting instance files /opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f_del
Aug 17 10:42:49 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Deletion of /opt/stack/data/nova/instances/fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f_del complete
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.219s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:42:49 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:42:49 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1538e6-5098-45ce-bb5f-9eedec36695c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:42:49 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a056bbf-54e8-4675-a2c8-b5f7b435b477]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950] added
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: INFO nova.compute.manager [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[93759459-a328-4648-84ef-c2874bcd4b38]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be1c93-93f6-4ca0-bb3b-ca273d99ce83]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXJerLlF {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXJerLlF" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[49af35d4-0780-4c52-8a7a-f5cc498bb1cd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXJerLlF'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[71259e82-00ae-405d-8651-a092f0c1c025]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cbdd3c-1972-4136-848b-f5e799fb71c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:42:49 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:42:49 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:42:49 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:42:49 user nova-compute[73158]: 
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827aee9-6a4d-472e-b00a-1a0fb782e947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260]
Aug 17 10:42:49 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260] successful.
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa7694-c36c-426a-9546-85663ec4c42a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d30791-8923-4fce-bfc3-e3fb592f3935]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 (non-flash)
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 (non-flash)
Aug 17 10:42:49 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14d59c2-1c6b-4e03-bff7-b9197b572be8]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXJerLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:49 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Took 0.47 seconds to deallocate network for instance.
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-c8a4178b-a3eb-42db-b77d-44906cf94e0a req-a8f0a420-8a93-42d0-a05d-9ea87d32d3f2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-deleted-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:49 user nova-compute[73158]: INFO nova.compute.manager [req-c8a4178b-a3eb-42db-b77d-44906cf94e0a req-a8f0a420-8a93-42d0-a05d-9ea87d32d3f2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Neutron deleted interface 48f8ecc4-3585-4edc-9fef-b1db4e2335a5; detaching it from the instance and deleting it from the info cache
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-c8a4178b-a3eb-42db-b77d-44906cf94e0a req-a8f0a420-8a93-42d0-a05d-9ea87d32d3f2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-c8a4178b-a3eb-42db-b77d-44906cf94e0a req-a8f0a420-8a93-42d0-a05d-9ea87d32d3f2 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Detach interface failed, port_id=48f8ecc4-3585-4edc-9fef-b1db4e2335a5, reason: Instance fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb257338-f8d4-4d2e-a3c5-1ada66f89d90 req-ced5a37d-2599-4302-b6b0-93074c69b8c0 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb257338-f8d4-4d2e-a3c5-1ada66f89d90 req-ced5a37d-2599-4302-b6b0-93074c69b8c0 service nova] Acquiring lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb257338-f8d4-4d2e-a3c5-1ada66f89d90 req-ced5a37d-2599-4302-b6b0-93074c69b8c0 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-bb257338-f8d4-4d2e-a3c5-1ada66f89d90 req-ced5a37d-2599-4302-b6b0-93074c69b8c0 service nova] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.compute.manager [req-bb257338-f8d4-4d2e-a3c5-1ada66f89d90 req-ced5a37d-2599-4302-b6b0-93074c69b8c0 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] No waiting events found dispatching network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:50 user nova-compute[73158]: WARNING nova.compute.manager [req-bb257338-f8d4-4d2e-a3c5-1ada66f89d90 req-ced5a37d-2599-4302-b6b0-93074c69b8c0 service nova] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Received unexpected event network-vif-plugged-48f8ecc4-3585-4edc-9fef-b1db4e2335a5 for instance with vm_state active and task_state deleting.
Aug 17 10:42:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '26438366261333665', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438366261333665', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.objects.instance [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'flavor' on Instance uuid 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:50 user nova-compute[73158]: INFO nova.compute.manager [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Deleting volume: 95310979-dda4-4af8-bd92-9276fabc84d0 {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:42:50 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:42:50 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:42:50 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:42:50 user nova-compute[73158]:   <serial>b3ee3733-a312-4c8b-bec3-b3c0c8c5a950</serial>
Aug 17 10:42:50 user nova-compute[73158]: </disk>
Aug 17 10:42:50 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:42:50 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] No VIF found with MAC fa:16:3e:c0:37:bb, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:51 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Deleted allocations for instance fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-d3faf6c0-3ba8-40c0-bd93-8fee41b098ac tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.030s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-bc2b4550-1b76-4f56-9738-91280019b7f8 tempest-TestShelveInstance-357169844 tempest-TestShelveInstance-357169844-project-member] Lock "fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.090s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:51 user nova-compute[73158]: INFO nova.compute.manager [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Terminating instance
Aug 17 10:42:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-unplugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-unplugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-unplugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] Acquiring lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.compute.manager [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] No waiting events found dispatching network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:42:52 user nova-compute[73158]: WARNING nova.compute.manager [req-2aebc7e3-e1ec-4bb1-82a5-2ab6e35d1ce0 req-726ec7e1-2661-4237-ab79-4234659c501a service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received unexpected event network-vif-plugged-f18d69ba-6933-4c36-b759-9265fbf2bcc3 for instance with vm_state active and task_state deleting.
Aug 17 10:42:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Instance destroyed successfully.
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lazy-loading 'resources' on Instance uuid 8c6322c6-8362-4ed0-b0b3-0b948678a62e {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T10:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324139457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324139457',id=41,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnMfzOdZyb+byLQqZLSZVbvEC9w/CDMq3NcG69yGgNk4+kqpx8giB6xj6gtHmcfalSHP+T97uv92/6V7IA44lBa7MftMPtoCTyIQEWesv3TsuekzGLI1RsjZzeLwBcERA==',key_name='tempest-keypair-42577443',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e64443813742dca6185cfd559df272',ramdisk_id='',reservation_id='r-dx6jo9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136258329',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136258329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:41:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbf2fd52d7184d43aa53bf0d9b2afeca',uuid=8c6322c6-8362-4ed0-b0b3-0b948678a62e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converting VIF {"id": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "address": "fa:16:3e:ee:7f:61", "network": {"id": "72d7ac60-476e-41bd-b8f4-f93b679b5a88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1533467236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e64443813742dca6185cfd559df272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d69ba-69", "ovs_interfaceid": "f18d69ba-6933-4c36-b759-9265fbf2bcc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG os_vif [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf18d69ba-69, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:42:52 user nova-compute[73158]: INFO os_vif [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:7f:61,bridge_name='br-int',has_traffic_filtering=True,id=f18d69ba-6933-4c36-b759-9265fbf2bcc3,network=Network(72d7ac60-476e-41bd-b8f4-f93b679b5a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d69ba-69')
Aug 17 10:42:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Deleting instance files /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e_del
Aug 17 10:42:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Deletion of /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e_del complete
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json" returned: 1 in 0.219s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk --force-share --output=json' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:42:52 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000029, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/8c6322c6-8362-4ed0-b0b3-0b948678a62e/disk
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:52 user nova-compute[73158]: INFO nova.compute.manager [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:52 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:42:53 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:42:53 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8262MB free_disk=24.12557601928711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 8c6322c6-8362-4ed0-b0b3-0b948678a62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:42:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:54 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:42:54 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Took 1.28 seconds to deallocate network for instance.
Aug 17 10:42:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-11caa9bf-3748-46ee-86c5-21412ad76db0 req-7d89e02d-2328-488f-82f9-b081a3a2f1e0 service nova] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Received event network-vif-deleted-f18d69ba-6933-4c36-b759-9265fbf2bcc3 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:42:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:42:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:42:54 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:42:54 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:42:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:54 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Deleted allocations for instance 8c6322c6-8362-4ed0-b0b3-0b948678a62e
Aug 17 10:42:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e60ad3b9-8c2b-4069-bd0d-e6d370259883 tempest-AttachVolumeShelveTestJSON-1136258329 tempest-AttachVolumeShelveTestJSON-1136258329-project-member] Lock "8c6322c6-8362-4ed0-b0b3-0b948678a62e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.577s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:42:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:42:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:42:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:42:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:42:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:03 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268968.9802115, fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:43:03 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] VM Stopped (Lifecycle Event)
Aug 17 10:43:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c9ea3edb-4968-41a8-950f-fe4c7ab63661 None None] [instance: fb10e2c7-b559-4fb9-a20c-f04aa2be1c5f] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:43:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:07 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692268972.629418, 8c6322c6-8362-4ed0-b0b3-0b948678a62e => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:43:07 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] VM Stopped (Lifecycle Event)
Aug 17 10:43:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-ffa350cd-f07d-4907-8c10-dabc15033b62 None None] [instance: 8c6322c6-8362-4ed0-b0b3-0b948678a62e] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:43:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:09 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:43:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:43:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:43:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:43:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:43:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:43:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:43:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:26 user nova-compute[73158]: INFO nova.compute.manager [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Detaching volume b3ee3733-a312-4c8b-bec3-b3c0c8c5a950
Aug 17 10:43:26 user nova-compute[73158]: INFO nova.virt.block_device [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Attempting to driver detach volume b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 from mountpoint /dev/vdb
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Attempting to detach device vdb from instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:43:26 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:43:26 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:43:26 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:43:26 user nova-compute[73158]:   <serial>b3ee3733-a312-4c8b-bec3-b3c0c8c5a950</serial>
Aug 17 10:43:26 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:43:26 user nova-compute[73158]: </disk>
Aug 17 10:43:26 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:43:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully detached device vdb from instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 from the persistent domain config.
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:43:26 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:43:26 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:43:26 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:43:26 user nova-compute[73158]:   <serial>b3ee3733-a312-4c8b-bec3-b3c0c8c5a950</serial>
Aug 17 10:43:26 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:43:26 user nova-compute[73158]: </disk>
Aug 17 10:43:26 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692269006.9044573, 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:43:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully detached device vdb from instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 from the live domain config.
Aug 17 10:43:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXJerLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:43:26 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258be7c-5e21-4a1a-bbfb-058546c21987]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfa4bf-195b-4c46-8535-bec10849b327]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 (non-flash)
Aug 17 10:43:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 (non-flash)
Aug 17 10:43:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6f0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada495fe-0bf3-4693-9fc9-28dc45d79ea9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ffb68a-9244-4221-84b7-836dab64fc32]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba560746-7850-4282-a27a-2ddd8b0596d6]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d0a8e2-ab3f-4b0f-bcfe-3e20b4cc4fab]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee71fdf-673f-4944-91e6-c8be49f60077]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b95a482-0d8d-4544-9bd6-918320881b31]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260]
Aug 17 10:43:27 user nova-compute[73158]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950, portal: 172.16.0.220,3260] successful.
Aug 17 10:43:27 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d03b13-94ef-4426-bfb4-8cca1c1d437c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== disconnect_volume: return (272ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:27 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'flavor' on Instance uuid 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23932ee2-6158-4ab1-8d36-611e51b22669 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.604s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:28 user nova-compute[73158]: INFO nova.compute.manager [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Terminating instance
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-cf94236c-7021-4e68-a6a2-2a592a433927 req-5718dc0d-c597-4ec0-a58a-7af1a94ba9ed service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-vif-unplugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cf94236c-7021-4e68-a6a2-2a592a433927 req-5718dc0d-c597-4ec0-a58a-7af1a94ba9ed service nova] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cf94236c-7021-4e68-a6a2-2a592a433927 req-5718dc0d-c597-4ec0-a58a-7af1a94ba9ed service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cf94236c-7021-4e68-a6a2-2a592a433927 req-5718dc0d-c597-4ec0-a58a-7af1a94ba9ed service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-cf94236c-7021-4e68-a6a2-2a592a433927 req-5718dc0d-c597-4ec0-a58a-7af1a94ba9ed service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] No waiting events found dispatching network-vif-unplugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-cf94236c-7021-4e68-a6a2-2a592a433927 req-5718dc0d-c597-4ec0-a58a-7af1a94ba9ed service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-vif-unplugged-3d4d319e-f734-45a2-849d-6075eb9d9746 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:43:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Instance destroyed successfully.
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lazy-loading 'resources' on Instance uuid 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-411686339',display_name='tempest-VolumesSnapshotTestJSON-instance-411686339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-411686339',id=44,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAylgMcX5fBjahBX5NWS5zskmgDDZUWELQtHI7Nk2ImQQJMZSPtGiNH+5eN2Ti0Q1T8lVgj9ouIbnmJ5aqk9BqMjUzpHVGuAuY2ARiYDES47bxCMNj1LCAsVINF24R+pg==',key_name='tempest-keypair-1036952370',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4eabe57c34e5cb39756add1e33773',ramdisk_id='',reservation_id='r-e0cuhtr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1699436377',owner_user_name='tempest-VolumesSnapshotTestJSON-1699436377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='445ca2aa192a4bd38fbd59aacf99c673',uuid=0dfe5e97-972e-47e4-b19d-ca51213f8bf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converting VIF {"id": "3d4d319e-f734-45a2-849d-6075eb9d9746", "address": "fa:16:3e:c0:37:bb", "network": {"id": "bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1931657050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c4eabe57c34e5cb39756add1e33773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4d319e-f7", "ovs_interfaceid": "3d4d319e-f734-45a2-849d-6075eb9d9746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_vif [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d4d319e-f7, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:43:28 user nova-compute[73158]: INFO os_vif [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:37:bb,bridge_name='br-int',has_traffic_filtering=True,id=3d4d319e-f734-45a2-849d-6075eb9d9746,network=Network(bedc7f90-6e98-4d7f-a67b-9b0e0df40d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4d319e-f7')
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXJerLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:43:28 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3ee3733-a312-4c8b-bec3-b3c0c8c5a950', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d3f6a3-3033-400b-962d-5e0bb6809b95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:28 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 17 10:43:28 user nova-compute[73158]: 
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca4ae97-abf5-4741-bff8-f6400625f978]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:43:28 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:43:28 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:43:28 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:43:28 user nova-compute[73158]: 
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c5360>, {}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Disconnecting from: [] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] <== disconnect_volume: return (44ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:43:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Deleting instance files /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1_del
Aug 17 10:43:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Deletion of /opt/stack/data/nova/instances/0dfe5e97-972e-47e4-b19d-ca51213f8bf1_del complete
Aug 17 10:43:28 user nova-compute[73158]: INFO nova.compute.manager [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 10:43:28 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:43:28 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:43:30 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Took 1.27 seconds to deallocate network for instance.
Aug 17 10:43:30 user nova-compute[73158]: WARNING nova.volume.cinder [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Attachment 07be4923-58ac-4f5e-bbed-c94af4ca7462 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 07be4923-58ac-4f5e-bbed-c94af4ca7462. (HTTP 404) (Request-ID: req-d7d5fa6a-2e62-4708-a92f-9a3a499518a2)
Aug 17 10:43:30 user nova-compute[73158]: INFO nova.compute.manager [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Took 0.02 seconds to detach 1 volumes for instance.
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:30 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Deleted allocations for instance 0dfe5e97-972e-47e4-b19d-ca51213f8bf1
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cce509da-f622-41f4-9ef8-d1c6c6df61e2 tempest-VolumesSnapshotTestJSON-1699436377 tempest-VolumesSnapshotTestJSON-1699436377-project-member] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.541s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] Acquiring lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] Lock "0dfe5e97-972e-47e4-b19d-ca51213f8bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] No waiting events found dispatching network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:43:30 user nova-compute[73158]: WARNING nova.compute.manager [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received unexpected event network-vif-plugged-3d4d319e-f734-45a2-849d-6075eb9d9746 for instance with vm_state deleted and task_state None.
Aug 17 10:43:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-12529e19-1a1c-4309-9947-59d9809f9884 req-b0a37ac5-a74e-4f7b-9874-e1eb6cd5ee1f service nova] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Received event network-vif-deleted-3d4d319e-f734-45a2-849d-6075eb9d9746 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:43:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:43 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269008.7784023, 0dfe5e97-972e-47e4-b19d-ca51213f8bf1 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:43:43 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] VM Stopped (Lifecycle Event)
Aug 17 10:43:43 user nova-compute[73158]: DEBUG nova.compute.manager [None req-539031ae-84cf-414a-b34c-fc94d00b7071 None None] [instance: 0dfe5e97-972e-47e4-b19d-ca51213f8bf1] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:43:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:44 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:43:47 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:43:48 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating instance_info_cache with network_info: [{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:43:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:43:48 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:43:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:43:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:53 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:54 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:43:54 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=24.170013427734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:43:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:43:58 user nova-compute[73158]: INFO nova.compute.claims [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Claim successful on node user
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:43:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.policy [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f99e22043434486a68dcc2a27e460b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb6a9281a3f44042a8d3e1448784314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:43:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Creating image(s)
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "/opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "/opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "/opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.187s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk 1073741824 {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc,backing_fmt=raw /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk 1073741824" returned: 0 in 0.061s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "507e1dc409f2943f74cd1a57c4baaa66f0b894cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc --force-share --output=json" returned: 0 in 0.191s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk. size=1073741824 {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Successfully created port: d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG nova.virt.disk.api [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Cannot resize image /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk to a smaller size. {{(pid=73158) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG nova.objects.instance [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'migration_context' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Created local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Ensure instance console log exists: /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:43:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Successfully updated port: d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-changed-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.compute.manager [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Refreshing instance network info cache due to event network-changed-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Instance network_info: |[{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Refreshing network info cache for port d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Start _get_guest_xml network_info=[{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '9b73e703-52fe-4fe4-ae2e-19e6c25bad78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:44:00 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:44:00 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T10:07:42Z,direct_url=<?>,disk_format='qcow2',id=9b73e703-52fe-4fe4-ae2e-19e6c25bad78,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ae623923ea484fa397cfea70bb290968',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T10:07:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-831802436',display_name='tempest-SnapshotDataIntegrityTests-server-831802436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-831802436',id=46,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI276mRPaxTkQ7zIgn6p7Tz36/4LxI9NBakq90srDQJrnN//8UqkZ9BuCn56it828BKZI44JXxstvMQNf89lwPR8JF4xKvYt/75W88KMWT//IrdXEcqI5swfYAtCCYW7Xg==',key_name='tempest-keypair-852897710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb6a9281a3f44042a8d3e1448784314c',ramdisk_id='',reservation_id='r-ml324e1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-206485675',owner_user_name='tempest-SnapshotDataIntegrityTests-206485675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f99e22043434486a68dcc2a27e460b1',uuid=93f8e821-eacf-400e-94d4-377bad79a560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Converting VIF {"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'pci_devices' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:44:00 user nova-compute[73158]:   <uuid>93f8e821-eacf-400e-94d4-377bad79a560</uuid>
Aug 17 10:44:00 user nova-compute[73158]:   <name>instance-0000002e</name>
Aug 17 10:44:00 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:44:00 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:44:00 user nova-compute[73158]:   <metadata>
Aug 17 10:44:00 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:44:00 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:44:00 user nova-compute[73158]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-831802436</nova:name>
Aug 17 10:44:00 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:44:00</nova:creationTime>
Aug 17 10:44:00 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:44:00 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:44:00 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:44:00 user nova-compute[73158]:       <nova:owner>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:user uuid="4f99e22043434486a68dcc2a27e460b1">tempest-SnapshotDataIntegrityTests-206485675-project-member</nova:user>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:project uuid="cb6a9281a3f44042a8d3e1448784314c">tempest-SnapshotDataIntegrityTests-206485675</nova:project>
Aug 17 10:44:00 user nova-compute[73158]:       </nova:owner>
Aug 17 10:44:00 user nova-compute[73158]:       <nova:root type="image" uuid="9b73e703-52fe-4fe4-ae2e-19e6c25bad78"/>
Aug 17 10:44:00 user nova-compute[73158]:       <nova:ports>
Aug 17 10:44:00 user nova-compute[73158]:         <nova:port uuid="d36b765a-ecdb-49ca-a4ff-8ab67917ebc8">
Aug 17 10:44:00 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 10:44:00 user nova-compute[73158]:         </nova:port>
Aug 17 10:44:00 user nova-compute[73158]:       </nova:ports>
Aug 17 10:44:00 user nova-compute[73158]:     </nova:instance>
Aug 17 10:44:00 user nova-compute[73158]:   </metadata>
Aug 17 10:44:00 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:44:00 user nova-compute[73158]:     <system>
Aug 17 10:44:00 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:44:00 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:44:00 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:44:00 user nova-compute[73158]:       <entry name="serial">93f8e821-eacf-400e-94d4-377bad79a560</entry>
Aug 17 10:44:00 user nova-compute[73158]:       <entry name="uuid">93f8e821-eacf-400e-94d4-377bad79a560</entry>
Aug 17 10:44:00 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:44:00 user nova-compute[73158]:     </system>
Aug 17 10:44:00 user nova-compute[73158]:   </sysinfo>
Aug 17 10:44:00 user nova-compute[73158]:   <os>
Aug 17 10:44:00 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:44:00 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:44:00 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:44:00 user nova-compute[73158]:   </os>
Aug 17 10:44:00 user nova-compute[73158]:   <features>
Aug 17 10:44:00 user nova-compute[73158]:     <acpi/>
Aug 17 10:44:00 user nova-compute[73158]:     <apic/>
Aug 17 10:44:00 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:44:00 user nova-compute[73158]:   </features>
Aug 17 10:44:00 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:44:00 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:44:00 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:44:00 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:44:00 user nova-compute[73158]:   </clock>
Aug 17 10:44:00 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:44:00 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:44:00 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:44:00 user nova-compute[73158]:   </cpu>
Aug 17 10:44:00 user nova-compute[73158]:   <devices>
Aug 17 10:44:00 user nova-compute[73158]:     <disk type="file" device="disk">
Aug 17 10:44:00 user nova-compute[73158]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 10:44:00 user nova-compute[73158]:       <source file="/opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk"/>
Aug 17 10:44:00 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:44:00 user nova-compute[73158]:     </disk>
Aug 17 10:44:00 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:44:00 user nova-compute[73158]:       <mac address="fa:16:3e:cb:b1:43"/>
Aug 17 10:44:00 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:44:00 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:44:00 user nova-compute[73158]:       <target dev="tapd36b765a-ec"/>
Aug 17 10:44:00 user nova-compute[73158]:     </interface>
Aug 17 10:44:00 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:44:00 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/console.log" append="off"/>
Aug 17 10:44:00 user nova-compute[73158]:     </serial>
Aug 17 10:44:00 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:44:00 user nova-compute[73158]:     <video>
Aug 17 10:44:00 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:44:00 user nova-compute[73158]:     </video>
Aug 17 10:44:00 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:44:00 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:44:00 user nova-compute[73158]:     </rng>
Aug 17 10:44:00 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:44:00 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:44:00 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:44:00 user nova-compute[73158]:     </memballoon>
Aug 17 10:44:00 user nova-compute[73158]:   </devices>
Aug 17 10:44:00 user nova-compute[73158]: </domain>
Aug 17 10:44:00 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-831802436',display_name='tempest-SnapshotDataIntegrityTests-server-831802436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-831802436',id=46,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI276mRPaxTkQ7zIgn6p7Tz36/4LxI9NBakq90srDQJrnN//8UqkZ9BuCn56it828BKZI44JXxstvMQNf89lwPR8JF4xKvYt/75W88KMWT//IrdXEcqI5swfYAtCCYW7Xg==',key_name='tempest-keypair-852897710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb6a9281a3f44042a8d3e1448784314c',ramdisk_id='',reservation_id='r-ml324e1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-206485675',owner_user_name='tempest-SnapshotDataIntegrityTests-206485675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f99e22043434486a68dcc2a27e460b1',uuid=93f8e821-eacf-400e-94d4-377bad79a560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Converting VIF {"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG os_vif [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd36b765a-ec, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd36b765a-ec, col_values=(('external_ids', {'iface-id': 'd36b765a-ecdb-49ca-a4ff-8ab67917ebc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:b1:43', 'vm-uuid': '93f8e821-eacf-400e-94d4-377bad79a560'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:00 user nova-compute[73158]: INFO os_vif [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec')
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No VIF found with MAC fa:16:3e:cb:b1:43, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:44:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated VIF entry in instance network info cache for port d36b765a-ecdb-49ca-a4ff-8ab67917ebc8. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:44:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:44:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b18e0695-2915-4859-a909-a3c959b8c1af req-f82f11af-6592-4efe-b7fa-28f7ce7c1f94 service nova] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-059a8d98-1b04-4207-ae39-e72bfd485772 req-0d704c33-d9c2-4b20-886f-311dd10f32a7 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-059a8d98-1b04-4207-ae39-e72bfd485772 req-0d704c33-d9c2-4b20-886f-311dd10f32a7 service nova] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-059a8d98-1b04-4207-ae39-e72bfd485772 req-0d704c33-d9c2-4b20-886f-311dd10f32a7 service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-059a8d98-1b04-4207-ae39-e72bfd485772 req-0d704c33-d9c2-4b20-886f-311dd10f32a7 service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-059a8d98-1b04-4207-ae39-e72bfd485772 req-0d704c33-d9c2-4b20-886f-311dd10f32a7 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] No waiting events found dispatching network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:44:02 user nova-compute[73158]: WARNING nova.compute.manager [req-059a8d98-1b04-4207-ae39-e72bfd485772 req-0d704c33-d9c2-4b20-886f-311dd10f32a7 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received unexpected event network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 for instance with vm_state building and task_state spawning.
Aug 17 10:44:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269044.1559534, 93f8e821-eacf-400e-94d4-377bad79a560 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] VM Resumed (Lifecycle Event)
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Instance spawned successfully.
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269044.1573281, 93f8e821-eacf-400e-94d4-377bad79a560 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] VM Started (Lifecycle Event)
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-9c8b948e-35f2-442a-bb7e-56ec5ac179a8 req-357b2476-e49f-479b-aca5-3f5d0deb4cfa service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9c8b948e-35f2-442a-bb7e-56ec5ac179a8 req-357b2476-e49f-479b-aca5-3f5d0deb4cfa service nova] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9c8b948e-35f2-442a-bb7e-56ec5ac179a8 req-357b2476-e49f-479b-aca5-3f5d0deb4cfa service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-9c8b948e-35f2-442a-bb7e-56ec5ac179a8 req-357b2476-e49f-479b-aca5-3f5d0deb4cfa service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-9c8b948e-35f2-442a-bb7e-56ec5ac179a8 req-357b2476-e49f-479b-aca5-3f5d0deb4cfa service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] No waiting events found dispatching network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:44:04 user nova-compute[73158]: WARNING nova.compute.manager [req-9c8b948e-35f2-442a-bb7e-56ec5ac179a8 req-357b2476-e49f-479b-aca5-3f5d0deb4cfa service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received unexpected event network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 for instance with vm_state building and task_state spawning.
Aug 17 10:44:04 user nova-compute[73158]: INFO nova.compute.manager [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Took 6.30 seconds to build instance.
Aug 17 10:44:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-253f05ab-9633-4ed8-9550-97a1d7033b70 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.415s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-changed-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:44:08 user nova-compute[73158]: DEBUG nova.compute.manager [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Refreshing instance network info cache due to event network-changed-07b0f879-1e82-4ac7-bb47-d41316b01f85. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:44:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] Acquiring lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:44:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] Acquired lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:44:08 user nova-compute[73158]: DEBUG nova.network.neutron [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Refreshing network info cache for port 07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:44:09 user nova-compute[73158]: DEBUG nova.network.neutron [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updated VIF entry in instance network info cache for port 07b0f879-1e82-4ac7-bb47-d41316b01f85. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:44:09 user nova-compute[73158]: DEBUG nova.network.neutron [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating instance_info_cache with network_info: [{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:44:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e24e7507-ac2b-4ba2-8833-9babf34df509 req-29e6b61e-6ad0-41c6-95f6-671fcb84965c service nova] Releasing lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:44:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lazy-loading 'flavor' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:14 user nova-compute[73158]: INFO nova.compute.manager [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Attaching volume 8cf2408e-253b-489c-89c2-34d2acad5616 to /dev/vdb
Aug 17 10:44:14 user nova-compute[73158]: DEBUG os_brick.utils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b07e40c-c13e-48c3-bd8d-d9ad3cf606d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe71c3-e6fd-4e6f-8629-3fd9676f2a9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43cc29b-1d12-4c38-8652-632928e86c95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a41627-5b77-46c1-880a-506ad96d63c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:44:14 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:44:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[86635444-143a-4fe5-b204-fe3fa150b96d]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG os_brick.utils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:44:14 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating existing volume attachment record: 5acd45ce-1e1a-46d1-82e9-64867ec35cd6 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:44:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHSQNPJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:44:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:44:25 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:44:25 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f4db55-0d24-423f-80b9-c94c318013a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:44:25 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd5c00-b2ef-4827-b72a-4b46a9bab945]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616] added
Aug 17 10:44:25 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce717c11-4a77-414e-8687-f27975017a8e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15fd1ce-ef8d-4953-be84-242042ffcc68]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHSQNPJG {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHSQNPJG" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe36f43-61ed-418e-90dd-365fa318ea4b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHSQNPJG'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87ad3a7-4a64-4e44-a699-26855363b275]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac0f4c7-8a1d-4d99-b40f-f71e3a9d8b85]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:44:26 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:44:26 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:44:26 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:44:26 user nova-compute[73158]: 
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[742cfa66-cd84-419b-b23c-1bb6afb791b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260]
Aug 17 10:44:26 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260] successful.
Aug 17 10:44:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[30415427-f001-42ed-b06e-73983cb43afd]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4edca9-a1fa-4f1f-849d-d9caf21a85ba]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 (non-flash)
Aug 17 10:44:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 (non-flash)
Aug 17 10:44:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d52d669-50e9-4a5d-93f1-966b45753191]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:44:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHSQNPJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26535326461393138', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535326461393138', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lazy-loading 'flavor' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:44:27 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:44:27 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:44:27 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:44:27 user nova-compute[73158]:   <serial>8cf2408e-253b-489c-89c2-34d2acad5616</serial>
Aug 17 10:44:27 user nova-compute[73158]: </disk>
Aug 17 10:44:27 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] No VIF found with MAC fa:16:3e:a9:46:7c, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:44:27 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1691112a-eb97-4f78-94a4-500934cae257 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.212s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:29 user nova-compute[73158]: INFO nova.compute.manager [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Detaching volume 8cf2408e-253b-489c-89c2-34d2acad5616
Aug 17 10:44:29 user nova-compute[73158]: INFO nova.virt.block_device [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Attempting to driver detach volume 8cf2408e-253b-489c-89c2-34d2acad5616 from mountpoint /dev/vdb
Aug 17 10:44:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Attempting to detach device vdb from instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:44:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:44:29 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:44:29 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:44:29 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:44:29 user nova-compute[73158]:   <serial>8cf2408e-253b-489c-89c2-34d2acad5616</serial>
Aug 17 10:44:29 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:44:29 user nova-compute[73158]: </disk>
Aug 17 10:44:29 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:44:29 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Successfully detached device vdb from instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 from the persistent domain config.
Aug 17 10:44:29 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:44:30 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:44:30 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:44:30 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:44:30 user nova-compute[73158]:   <serial>8cf2408e-253b-489c-89c2-34d2acad5616</serial>
Aug 17 10:44:30 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:44:30 user nova-compute[73158]: </disk>
Aug 17 10:44:30 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692269070.5351913, 7170e6d3-7c52-4170-97e4-2a0057c2f084 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:44:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Successfully detached device vdb from instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 from the live domain config.
Aug 17 10:44:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHSQNPJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:44:30 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4dea35-befe-453d-ad03-c3d4e988c4b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaff7d8-6f5c-4257-be74-f1a03dde85ce]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 (non-flash)
Aug 17 10:44:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 (non-flash)
Aug 17 10:44:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6f0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acffcdd-13b6-42fd-b380-a97ba9d9b928]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70aa716-1c75-409e-8692-225ebc8f694a]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d33600-4486-4541-9995-4d7942c7db9d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0fceb3-2f6c-438f-8513-39b4470c4430]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa5843-d2e0-47e4-99a7-bba57d5289d7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dc5f15-4bc2-44c4-968d-c33dc7b5d39e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260]
Aug 17 10:44:30 user nova-compute[73158]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616, portal: 172.16.0.220,3260] successful.
Aug 17 10:44:30 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf2408e-253b-489c-89c2-34d2acad5616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d629d1-6bc3-4eb0-b0fa-fea4c4796b75]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] <== disconnect_volume: return (276ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:44:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:44:31 user nova-compute[73158]: DEBUG nova.objects.instance [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lazy-loading 'flavor' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:44:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-dc5c4020-ba8d-4fb9-9796-5bdeb52e3ee7 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.793s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:43 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:44:49 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating instance_info_cache with network_info: [{"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-7170e6d3-7c52-4170-97e4-2a0057c2f084" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:44:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:44:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:44:56 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:44:56 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=24.129276275634766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 7170e6d3-7c52-4170-97e4-2a0057c2f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:44:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:45:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:45:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:45:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:29 user nova-compute[73158]: INFO nova.compute.manager [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Terminating instance
Aug 17 10:45:29 user nova-compute[73158]: DEBUG nova.compute.manager [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:45:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-668f87ab-5857-4656-a989-1ed23fc69037 req-20aa7383-871a-4a2f-a48e-0e563944e355 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-vif-unplugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-668f87ab-5857-4656-a989-1ed23fc69037 req-20aa7383-871a-4a2f-a48e-0e563944e355 service nova] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-668f87ab-5857-4656-a989-1ed23fc69037 req-20aa7383-871a-4a2f-a48e-0e563944e355 service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-668f87ab-5857-4656-a989-1ed23fc69037 req-20aa7383-871a-4a2f-a48e-0e563944e355 service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-668f87ab-5857-4656-a989-1ed23fc69037 req-20aa7383-871a-4a2f-a48e-0e563944e355 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] No waiting events found dispatching network-vif-unplugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.compute.manager [req-668f87ab-5857-4656-a989-1ed23fc69037 req-20aa7383-871a-4a2f-a48e-0e563944e355 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-vif-unplugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Instance destroyed successfully.
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.objects.instance [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lazy-loading 'resources' on Instance uuid 7170e6d3-7c52-4170-97e4-2a0057c2f084 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-228871410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2288714',id=45,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQoh7LcnMnPRCdV8d9S4RDMhB6XU1ogKSQhGuUYAVh9Gy0J9eYABCjA4u8gx6X/6XZrOjYWKPVZ2yDKyBAm0aEjb2twcr6QPqLLNPng6uuxtIdf21pSzwP1WYA3s+q9hg==',key_name='tempest-keypair-1845836502',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21fd98665d7b496ba078b65d7f9f5565',ramdisk_id='',reservation_id='r-r4vzh9e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2124696365',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5637661c3d2046ffb53dbdb91d290a53',uuid=7170e6d3-7c52-4170-97e4-2a0057c2f084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Converting VIF {"id": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "address": "fa:16:3e:a9:46:7c", "network": {"id": "1fdaee88-3957-415e-94f7-d18cb7a377a6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1478734348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21fd98665d7b496ba078b65d7f9f5565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b0f879-1e", "ovs_interfaceid": "07b0f879-1e82-4ac7-bb47-d41316b01f85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG os_vif [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07b0f879-1e, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:30 user nova-compute[73158]: INFO os_vif [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=07b0f879-1e82-4ac7-bb47-d41316b01f85,network=Network(1fdaee88-3957-415e-94f7-d18cb7a377a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b0f879-1e')
Aug 17 10:45:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Deleting instance files /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084_del
Aug 17 10:45:30 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Deletion of /opt/stack/data/nova/instances/7170e6d3-7c52-4170-97e4-2a0057c2f084_del complete
Aug 17 10:45:30 user nova-compute[73158]: INFO nova.compute.manager [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 10:45:30 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:45:30 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:45:31 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Took 0.84 seconds to deallocate network for instance.
Aug 17 10:45:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:45:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:31 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Deleted allocations for instance 7170e6d3-7c52-4170-97e4-2a0057c2f084
Aug 17 10:45:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-5ef9d29c-39f7-4329-b128-1f762fde4c72 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365 tempest-TestServerVolumeAttachScenarioOldVersion-2124696365-project-member] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:32 user nova-compute[73158]: DEBUG nova.compute.manager [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:45:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] Acquiring lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:32 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] Lock "7170e6d3-7c52-4170-97e4-2a0057c2f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:32 user nova-compute[73158]: DEBUG nova.compute.manager [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] No waiting events found dispatching network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:45:32 user nova-compute[73158]: WARNING nova.compute.manager [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received unexpected event network-vif-plugged-07b0f879-1e82-4ac7-bb47-d41316b01f85 for instance with vm_state deleted and task_state None.
Aug 17 10:45:32 user nova-compute[73158]: DEBUG nova.compute.manager [req-3af5c7fc-d636-4eec-b9cb-147f39755126 req-6523a09a-6b8f-4570-b26a-ad8dd08c2cd5 service nova] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Received event network-vif-deleted-07b0f879-1e82-4ac7-bb47-d41316b01f85 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:45:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:45:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:45:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:45 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269130.6950743, 7170e6d3-7c52-4170-97e4-2a0057c2f084 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:45:45 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] VM Stopped (Lifecycle Event)
Aug 17 10:45:45 user nova-compute[73158]: DEBUG nova.compute.manager [None req-d556e2fe-42bc-4874-bc64-4f105d0b627f None None] [instance: 7170e6d3-7c52-4170-97e4-2a0057c2f084] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:45:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:46 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:48 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-changed-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Refreshing instance network info cache due to event network-changed-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Refreshing network info cache for port d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated VIF entry in instance network info cache for port d36b765a-ecdb-49ca-a4ff-8ab67917ebc8. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1caa59dc-88b9-4fde-9059-c28350de0148 req-d8d6aedb-6424-4ee8-972f-38f6aaa2ad5e service nova] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:45:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:45:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:45:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:54 user nova-compute[73158]: INFO nova.compute.manager [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attaching volume 1f981f80-089b-4505-a4c7-a0f56a7d9bc3 to /dev/vdb
Aug 17 10:45:54 user nova-compute[73158]: DEBUG os_brick.utils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef2a6d-9214-4920-8707-97e8d0aa7a1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c451a01-8989-4128-a73d-f7db104b447d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d70ec-4ac6-45e4-8ecb-89c59695ffe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c01b4-9a6e-47b3-8518-1d05f4091d65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:45:54 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:45:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4fff76-d6c5-49f3-810e-b51f469a49c6]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG os_brick.utils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:45:54 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating existing volume attachment record: 1a336fdb-dba1-4a0c-9467-1ee49a77a073 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:45:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:45:56 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:45:56 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=24.155101776123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:45:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:45:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcntvuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:46:04 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:46:04 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:46:04 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f085375-7f21-436b-9ddd-eb46d58c974a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:46:04 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6bab1-5efc-4220-b6d8-f1f05375c952]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3] added
Aug 17 10:46:04 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa3fa0-5dde-46d0-9e28-84837b5fbc55]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3321e0fb-c7ea-4850-a8d8-915510ceccad]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEcntvuW {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEcntvuW" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa737412-26ef-47e1-a6c5-358173351023]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEcntvuW'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866dde3-e11b-4a03-a70c-8a197e7c1c30]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc86fcf-727b-44ae-ae09-d9187471c976]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:46:04 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:46:04 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:46:04 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:46:04 user nova-compute[73158]: 
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5457ade-5afc-48bc-94d0-8df40dedaf14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260]
Aug 17 10:46:04 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260] successful.
Aug 17 10:46:04 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4e0d6-22c2-4ca8-bc6e-52529dc6f6c4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[408ca066-42ae-4f43-8327-def9bf9c3ec3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 (non-flash)
Aug 17 10:46:04 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 (non-flash)
Aug 17 10:46:04 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a24ea-ba4d-4d7f-8467-b8b3705fad0a]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:04 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcntvuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23836613030333435', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836613030333435', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:46:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:46:05 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:46:05 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:46:05 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:46:05 user nova-compute[73158]:   <serial>1f981f80-089b-4505-a4c7-a0f56a7d9bc3</serial>
Aug 17 10:46:05 user nova-compute[73158]: </disk>
Aug 17 10:46:05 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:46:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:46:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:46:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No VIF found with MAC fa:16:3e:cb:b1:43, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:46:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4ea4914d-c55b-42b5-85a1-2b59ce134c0b tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.074s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:46:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:25 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:30 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:35 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:46:35 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:46:35 user nova-compute[73158]: INFO nova.compute.manager [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Detaching volume 1f981f80-089b-4505-a4c7-a0f56a7d9bc3
Aug 17 10:46:35 user nova-compute[73158]: INFO nova.virt.block_device [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attempting to driver detach volume 1f981f80-089b-4505-a4c7-a0f56a7d9bc3 from mountpoint /dev/vdb
Aug 17 10:46:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Attempting to detach device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:46:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:46:35 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:46:35 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:46:35 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:46:35 user nova-compute[73158]:   <serial>1f981f80-089b-4505-a4c7-a0f56a7d9bc3</serial>
Aug 17 10:46:35 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:46:35 user nova-compute[73158]: </disk>
Aug 17 10:46:35 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:46:35 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config.
Aug 17 10:46:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:46:35 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:46:35 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:46:35 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:46:35 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:46:35 user nova-compute[73158]:   <serial>1f981f80-089b-4505-a4c7-a0f56a7d9bc3</serial>
Aug 17 10:46:35 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:46:35 user nova-compute[73158]: </disk>
Aug 17 10:46:35 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692269196.324006, 93f8e821-eacf-400e-94d4-377bad79a560 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:46:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config.
Aug 17 10:46:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcntvuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:46:36 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a737f6-669d-4cb5-9f50-a150e08a8c03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e42821-8c69-45f6-a507-2254f6fe63fc]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 (non-flash)
Aug 17 10:46:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 (non-flash)
Aug 17 10:46:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c16fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1902d1b5-b6cd-45ae-83e8-c6241af17dac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e46198-0705-4cb1-b43c-e6fff8319b1b]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[64974f7f-243c-488b-b3ad-76e58563b680]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c8252c-264d-4cd1-91fb-8f1fa104f35e]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e75e12-3250-485b-90a5-9decfe3f53c7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[402cb495-1ca6-42bb-98d1-6683a2fe93f2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260]
Aug 17 10:46:36 user nova-compute[73158]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3, portal: 172.16.0.220,3260] successful.
Aug 17 10:46:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f981f80-089b-4505-a4c7-a0f56a7d9bc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad25d5-6fae-4232-a979-377e3dc43c22]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== disconnect_volume: return (272ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:46:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:46:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:46:37 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-377c7713-a010-4e8c-9e6f-a61343827f04 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:46:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:40 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:46:49 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:46:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:50 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:46:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:55 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:46:57 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:46:58 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:46:58 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=24.144512176513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:46:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:47:03 user nova-compute[73158]: INFO nova.compute.claims [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Claim successful on node user
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:47:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:47:03 user nova-compute[73158]: INFO nova.virt.block_device [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Booting with volume snapshot bd016efb-4f81-43b8-9fcd-1022c9bfda88 at /dev/vda
Aug 17 10:47:03 user nova-compute[73158]: DEBUG nova.policy [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d339d632dc04d9996c284a37269ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b44dd2b2840f19d651e921cb73ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:47:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Successfully created port: 6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Successfully updated port: 6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquired lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-changed-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Refreshing instance network info cache due to event network-changed-6541ffa5-e711-4022-946b-a5307449dfdf. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] Acquiring lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updating instance_info_cache with network_info: [{"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Releasing lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Instance network_info: |[{"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] Acquired lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Refreshing network info cache for port 6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updated VIF entry in instance network info cache for port 6541ffa5-e711-4022-946b-a5307449dfdf. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updating instance_info_cache with network_info: [{"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:47:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-a0fd8d8b-e9e1-45d8-a43e-6914eb133cc7 req-d3107c53-e0da-4e45-b397-5c61a5d39f80 service nova] Releasing lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:47:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG os_brick.utils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6212a722-78f0-4ff5-bcd7-78c92842cfc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a3e44b-cabe-410c-bf66-7d580a8773c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac938678-5716-453c-89b9-4a7e09884308]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d066b-c75f-4925-8bf1-ca9033422bc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:47:09 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:47:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[86130fb2-b636-477f-984d-6670dfc6467b]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG os_brick.utils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:47:09 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updating existing volume attachment record: 21a208ac-c76d-44a6-b80d-68a33644b4b4 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:47:10 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Verify base images {{(pid=73158) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73158) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Image id 9b73e703-52fe-4fe4-ae2e-19e6c25bad78 yields fingerprint 507e1dc409f2943f74cd1a57c4baaa66f0b894cc {{(pid=73158) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] image 9b73e703-52fe-4fe4-ae2e-19e6c25bad78 at (/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc): checking
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] image 9b73e703-52fe-4fe4-ae2e-19e6c25bad78 at (/opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc): image is in use {{(pid=73158) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] 93f8e821-eacf-400e-94d4-377bad79a560 is a valid instance name {{(pid=73158) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] 93f8e821-eacf-400e-94d4-377bad79a560 has a disk file {{(pid=73158) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 is backed by 507e1dc409f2943f74cd1a57c4baaa66f0b894cc {{(pid=73158) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f
Aug 17 10:47:13 user nova-compute[73158]: WARNING nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Active base files: /opt/stack/data/nova/instances/_base/507e1dc409f2943f74cd1a57c4baaa66f0b894cc
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Removable base files: /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17 /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8 /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476 /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503 /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/87d320151565e5669b57047bf92f51508d51ac17
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/84e480ce23b73ab5a85c56116cacd5e23866e97c
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/681aca725f5b459c4ee0e4d9aea161f1596e5cd8
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bc1268f51012ab2a94acd100de30d5302fd6933d
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4b1502d26d1eb94f31a266e0a7742188262d1fac
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/361a612d803cc11700c3b0c7385d695e3d3f1476
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7594c541bdd841af102165e7b3a66b86450d1503
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f7770cec0d75cfce4b66e053c5833b46404a9b2f
Aug 17 10:47:13 user nova-compute[73158]: INFO nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4d6dbf3c5bbd1e6830f3a749a0641c350d435308
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Verification complete {{(pid=73158) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Verify swap images {{(pid=73158) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 10:47:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.imagecache [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Verify ephemeral images {{(pid=73158) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 10:47:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:47:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:47:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:47:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:47:15 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:47:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Creating image(s)
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Ensure instance console log exists: /opt/stack/data/nova/instances/6c4b0427-a1e6-4a4a-b015-a12453a709f2/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Start _get_guest_xml network_info=[{"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '21a208ac-c76d-44a6-b80d-68a33644b4b4', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDmrwAFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c4b0427-a1e6-4a4a-b015-a12453a709f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1d0d5d0-197b-4271-8cac-87fd1304c793', 'serial': 'd1d0d5d0-197b-4271-8cac-87fd1304c793'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:47:19 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:47:19 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDmrwAFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:47:19 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:47:19 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:47:19 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[64706ede-9841-49e1-8d30-d5d5d3bab942]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:47:19 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0bd2a-8ee6-4697-99f4-08b9ca787bc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793] added
Aug 17 10:47:19 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd661750-7f1a-4019-a31c-bb7e971dc136]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:19 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc1c737-246e-4383-88b8-9e99f36f4a50]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDmrwAFb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDmrwAFb" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7144f0f-d899-467b-a344-8d0e73b093cb]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IDmrwAFb'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[35489827-857d-4cce-be1c-1fa334edf926]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d2133-02fb-43e0-83a5-285940fcdd8d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:47:20 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:47:20 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:47:20 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:47:20 user nova-compute[73158]: 
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e72d8aa-1d5e-4000-aa15-e9d2e184a36a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260]
Aug 17 10:47:20 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260] successful.
Aug 17 10:47:20 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09b475e-1be5-4b04-87b6-567cb68a150c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed9db0-5c78-4b37-ae61-32df47e547a5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:20 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:20 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9711c5-cf7f-447c-9e9d-c620151b683d]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDmrwAFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:47:20 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23865623736616166', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865623736616166', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-857713086',display_name='tempest-TestVolumeBootPattern-server-857713086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-857713086',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-sw11zf31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:47:04Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=6c4b0427-a1e6-4a4a-b015-a12453a709f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c4b0427-a1e6-4a4a-b015-a12453a709f2 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:47:21 user nova-compute[73158]:   <uuid>6c4b0427-a1e6-4a4a-b015-a12453a709f2</uuid>
Aug 17 10:47:21 user nova-compute[73158]:   <name>instance-0000002f</name>
Aug 17 10:47:21 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:47:21 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:47:21 user nova-compute[73158]:   <metadata>
Aug 17 10:47:21 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:47:21 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:47:21 user nova-compute[73158]:       <nova:name>tempest-TestVolumeBootPattern-server-857713086</nova:name>
Aug 17 10:47:21 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:47:19</nova:creationTime>
Aug 17 10:47:21 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:47:21 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:47:21 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:47:21 user nova-compute[73158]:       <nova:owner>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:user uuid="9d339d632dc04d9996c284a37269ee55">tempest-TestVolumeBootPattern-1100093910-project-member</nova:user>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:project uuid="356b44dd2b2840f19d651e921cb73ba7">tempest-TestVolumeBootPattern-1100093910</nova:project>
Aug 17 10:47:21 user nova-compute[73158]:       </nova:owner>
Aug 17 10:47:21 user nova-compute[73158]:       <nova:ports>
Aug 17 10:47:21 user nova-compute[73158]:         <nova:port uuid="6541ffa5-e711-4022-946b-a5307449dfdf">
Aug 17 10:47:21 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 10:47:21 user nova-compute[73158]:         </nova:port>
Aug 17 10:47:21 user nova-compute[73158]:       </nova:ports>
Aug 17 10:47:21 user nova-compute[73158]:     </nova:instance>
Aug 17 10:47:21 user nova-compute[73158]:   </metadata>
Aug 17 10:47:21 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:47:21 user nova-compute[73158]:     <system>
Aug 17 10:47:21 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:47:21 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:47:21 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:47:21 user nova-compute[73158]:       <entry name="serial">6c4b0427-a1e6-4a4a-b015-a12453a709f2</entry>
Aug 17 10:47:21 user nova-compute[73158]:       <entry name="uuid">6c4b0427-a1e6-4a4a-b015-a12453a709f2</entry>
Aug 17 10:47:21 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:47:21 user nova-compute[73158]:     </system>
Aug 17 10:47:21 user nova-compute[73158]:   </sysinfo>
Aug 17 10:47:21 user nova-compute[73158]:   <os>
Aug 17 10:47:21 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:47:21 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:47:21 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:47:21 user nova-compute[73158]:   </os>
Aug 17 10:47:21 user nova-compute[73158]:   <features>
Aug 17 10:47:21 user nova-compute[73158]:     <acpi/>
Aug 17 10:47:21 user nova-compute[73158]:     <apic/>
Aug 17 10:47:21 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:47:21 user nova-compute[73158]:   </features>
Aug 17 10:47:21 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:47:21 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:47:21 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:47:21 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:47:21 user nova-compute[73158]:   </clock>
Aug 17 10:47:21 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:47:21 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:47:21 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:47:21 user nova-compute[73158]:   </cpu>
Aug 17 10:47:21 user nova-compute[73158]:   <devices>
Aug 17 10:47:21 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:47:21 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:47:21 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:47:21 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:47:21 user nova-compute[73158]:       <serial>d1d0d5d0-197b-4271-8cac-87fd1304c793</serial>
Aug 17 10:47:21 user nova-compute[73158]:     </disk>
Aug 17 10:47:21 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:47:21 user nova-compute[73158]:       <mac address="fa:16:3e:64:8f:9b"/>
Aug 17 10:47:21 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:47:21 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:47:21 user nova-compute[73158]:       <target dev="tap6541ffa5-e7"/>
Aug 17 10:47:21 user nova-compute[73158]:     </interface>
Aug 17 10:47:21 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:47:21 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/6c4b0427-a1e6-4a4a-b015-a12453a709f2/console.log" append="off"/>
Aug 17 10:47:21 user nova-compute[73158]:     </serial>
Aug 17 10:47:21 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:47:21 user nova-compute[73158]:     <video>
Aug 17 10:47:21 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:47:21 user nova-compute[73158]:     </video>
Aug 17 10:47:21 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:47:21 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:47:21 user nova-compute[73158]:     </rng>
Aug 17 10:47:21 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:47:21 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:47:21 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:47:21 user nova-compute[73158]:     </memballoon>
Aug 17 10:47:21 user nova-compute[73158]:   </devices>
Aug 17 10:47:21 user nova-compute[73158]: </domain>
Aug 17 10:47:21 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-857713086',display_name='tempest-TestVolumeBootPattern-server-857713086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-857713086',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-sw11zf31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:47:04Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=6c4b0427-a1e6-4a4a-b015-a12453a709f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG os_vif [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6541ffa5-e7, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6541ffa5-e7, col_values=(('external_ids', {'iface-id': '6541ffa5-e711-4022-946b-a5307449dfdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:8f:9b', 'vm-uuid': '6c4b0427-a1e6-4a4a-b015-a12453a709f2'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:21 user nova-compute[73158]: INFO os_vif [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7')
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:47:21 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No VIF found with MAC fa:16:3e:64:8f:9b, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-55b3f1a4-fd77-41c0-b1a4-bb47d34a3b9a req-43805f92-9924-414d-9405-23941a486471 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-55b3f1a4-fd77-41c0-b1a4-bb47d34a3b9a req-43805f92-9924-414d-9405-23941a486471 service nova] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-55b3f1a4-fd77-41c0-b1a4-bb47d34a3b9a req-43805f92-9924-414d-9405-23941a486471 service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-55b3f1a4-fd77-41c0-b1a4-bb47d34a3b9a req-43805f92-9924-414d-9405-23941a486471 service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:22 user nova-compute[73158]: DEBUG nova.compute.manager [req-55b3f1a4-fd77-41c0-b1a4-bb47d34a3b9a req-43805f92-9924-414d-9405-23941a486471 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] No waiting events found dispatching network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:47:22 user nova-compute[73158]: WARNING nova.compute.manager [req-55b3f1a4-fd77-41c0-b1a4-bb47d34a3b9a req-43805f92-9924-414d-9405-23941a486471 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received unexpected event network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf for instance with vm_state building and task_state spawning.
Aug 17 10:47:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269244.651257, 6c4b0427-a1e6-4a4a-b015-a12453a709f2 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] VM Resumed (Lifecycle Event)
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Instance spawned successfully.
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269244.6565027, 6c4b0427-a1e6-4a4a-b015-a12453a709f2 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] VM Started (Lifecycle Event)
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:47:24 user nova-compute[73158]: INFO nova.compute.manager [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Took 21.71 seconds to build instance.
Aug 17 10:47:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e75963f6-a0b0-4552-8b9e-52b8754f7ae1 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.811s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-e81deb61-7fcd-4ee4-bf79-cff79547d3a8 req-a745e86b-9bad-453d-bc5a-d7fa0b88970e service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e81deb61-7fcd-4ee4-bf79-cff79547d3a8 req-a745e86b-9bad-453d-bc5a-d7fa0b88970e service nova] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e81deb61-7fcd-4ee4-bf79-cff79547d3a8 req-a745e86b-9bad-453d-bc5a-d7fa0b88970e service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-e81deb61-7fcd-4ee4-bf79-cff79547d3a8 req-a745e86b-9bad-453d-bc5a-d7fa0b88970e service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:24 user nova-compute[73158]: DEBUG nova.compute.manager [req-e81deb61-7fcd-4ee4-bf79-cff79547d3a8 req-a745e86b-9bad-453d-bc5a-d7fa0b88970e service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] No waiting events found dispatching network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:47:24 user nova-compute[73158]: WARNING nova.compute.manager [req-e81deb61-7fcd-4ee4-bf79-cff79547d3a8 req-a745e86b-9bad-453d-bc5a-d7fa0b88970e service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received unexpected event network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf for instance with vm_state active and task_state None.
Aug 17 10:47:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:30 user nova-compute[73158]: INFO nova.compute.manager [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attaching volume 4c7ab9f7-53d0-45fd-8293-5cdb56477d77 to /dev/vdb
Aug 17 10:47:30 user nova-compute[73158]: DEBUG os_brick.utils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[38284f32-3495-4881-8e0b-d175a730df97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a0ccfd-5ba5-4918-81e2-4336e31b5172]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db34896b-b115-44fb-87f5-8427520181ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[06712ef9-3f1d-4a7f-89c5-74aaa512f6d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:47:30 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:47:30 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394d75e-3ba3-42e1-8738-99369f6f4277]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG os_brick.utils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:47:30 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating existing volume attachment record: ed07c53f-6de4-4ffe-95de-ee3783c3bf88 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:47:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZVNvHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:47:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:47:40 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:47:40 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[812622ac-2506-4973-b070-f970c054fc26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:47:40 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c4997-292c-4240-b14c-3deaf88a7f18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77] added
Aug 17 10:47:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dfeacd-47c8-4a83-a2d8-77ad856b9957]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e341f-e7ba-4ff8-ad56-55f1e8981973]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGZVNvHB {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGZVNvHB" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb76aeb-838d-40c5-a1aa-a68f53d5ef0c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGZVNvHB'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf00bf-e7f4-4ebc-872c-1e9267188f77]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c9fd9c-1820-470d-8d5c-5e14d53de134]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f502d6c-d965-430e-b7fc-878a035394be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260]
Aug 17 10:47:40 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260] successful.
Aug 17 10:47:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c486b-0c90-48fb-87ac-fd69583cde2b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a151bda-522f-4f62-abc3-c54d3d6d87cd]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:40 user nova-compute[73158]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 (non-flash)
Aug 17 10:47:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:40 user nova-compute[73158]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 (non-flash)
Aug 17 10:47:40 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7a9a0-e450-4204-91ed-1982c8715add]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:40 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZVNvHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23731613263343038', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731613263343038', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG nova.objects.instance [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:47:41 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:47:41 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:47:41 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:47:41 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:47:41 user nova-compute[73158]:   <serial>4c7ab9f7-53d0-45fd-8293-5cdb56477d77</serial>
Aug 17 10:47:41 user nova-compute[73158]: </disk>
Aug 17 10:47:41 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:47:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:47:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:47:42 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No VIF found with MAC fa:16:3e:cb:b1:43, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:47:42 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-9116e151-778c-42b5-8568-5e2949bdd958 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.161s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:45 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:45 user nova-compute[73158]: INFO nova.compute.manager [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Detaching volume 4c7ab9f7-53d0-45fd-8293-5cdb56477d77
Aug 17 10:47:45 user nova-compute[73158]: INFO nova.virt.block_device [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attempting to driver detach volume 4c7ab9f7-53d0-45fd-8293-5cdb56477d77 from mountpoint /dev/vdb
Aug 17 10:47:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Attempting to detach device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:47:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:47:45 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:47:45 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:47:45 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:47:45 user nova-compute[73158]:   <serial>4c7ab9f7-53d0-45fd-8293-5cdb56477d77</serial>
Aug 17 10:47:45 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:47:45 user nova-compute[73158]: </disk>
Aug 17 10:47:45 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:47:45 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config.
Aug 17 10:47:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:47:45 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:47:45 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:47:45 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:47:45 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:47:45 user nova-compute[73158]:   <serial>4c7ab9f7-53d0-45fd-8293-5cdb56477d77</serial>
Aug 17 10:47:45 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:47:45 user nova-compute[73158]: </disk>
Aug 17 10:47:45 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692269266.1019795, 93f8e821-eacf-400e-94d4-377bad79a560 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:47:46 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config.
Aug 17 10:47:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZVNvHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:47:46 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb06169d-c5e7-435d-8172-a532e2fc8c5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b70b9-9937-4c0f-9aae-7985f4665be3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:46 user nova-compute[73158]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 (non-flash)
Aug 17 10:47:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:47:46 user nova-compute[73158]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 (non-flash)
Aug 17 10:47:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c47c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb199197-b6eb-4ae8-ba5c-64d9c51b381a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8428a290-ae82-4f5d-8aee-5e92e2509132]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036430c-a45f-46be-bd3e-32a764582f98]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f421d229-fc85-483d-9703-620b6e2a9ab6]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e6fd28-70bc-4244-a358-26c08d9e0356]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fc14ac-9145-4a9a-a8d4-c7c94c0a9b3f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260]
Aug 17 10:47:46 user nova-compute[73158]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77, portal: 172.16.0.220,3260] successful.
Aug 17 10:47:46 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7ab9f7-53d0-45fd-8293-5cdb56477d77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b250a-ad32-408f-bfa9-9b1f0a26ea56]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== disconnect_volume: return (251ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:47:46 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:47:47 user nova-compute[73158]: DEBUG nova.objects.instance [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:47:47 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-934aa4d9-bead-42ee-9dbf-8657561af145 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.558s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:49 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:47:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:47:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:47:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:47:59 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:47:59 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=24.14214324951172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6c4b0427-a1e6-4a4a-b015-a12453a709f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:47:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:03 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:48:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:48:03 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:10 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:10 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:48:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:48:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:39 user nova-compute[73158]: INFO nova.compute.manager [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attaching volume 2d91e3f5-a24e-4ca0-b094-a2caebb98f72 to /dev/vdb
Aug 17 10:48:39 user nova-compute[73158]: DEBUG os_brick.utils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:48:39 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fb8b8c-0af6-41b3-99d4-90c06075ca20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de2d35-742a-4877-8f34-7501ecbcf77c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07a39a-1a01-43c9-9185-d7ed96bcf5f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbe0d28-01fe-408b-af84-fa75cfafd0fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:48:40 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:48:40 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b060a-2ee9-4ad0-85f3-2c7cbd081db0]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG os_brick.utils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:48:40 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating existing volume attachment record: b9874084-69ad-459d-a6c1-95d0d99c4423 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:48:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:48:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:47 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMgfyKwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:48:50 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:48:50 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:48:50 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5f91f-10a2-497b-a8cc-da61bf190f54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:48:50 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70f0a73-812c-4290-832e-4f86a4c97289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72] added
Aug 17 10:48:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8d5922-7a9f-41ac-9589-e46b29eedaf0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[006a3828-f5e7-4a33-b37d-5c53e379c9ba]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMgfyKwo {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMgfyKwo" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f52f2a-a293-4284-b769-cda7599d3463]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMgfyKwo'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[612d0530-73b7-47fd-af31-cbdea4009a67]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb2854-429c-4761-843b-aedc6d9a5214]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:48:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:48:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83188e35-3318-4775-9db5-ab81231570be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260]
Aug 17 10:48:50 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260] successful.
Aug 17 10:48:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc3a891-1af1-49c3-9ea9-51aab3b4839b]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d167eb-ce39-4c49-8a83-a8a4dd10ba33]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:48:50 user nova-compute[73158]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)
Aug 17 10:48:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:48:50 user nova-compute[73158]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)
Aug 17 10:48:50 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d8cbe-b865-4932-af68-d049ba08ec1c]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:48:50 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMgfyKwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23930373738636334', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930373738636334', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:48:51 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:48:51 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:48:51 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:48:51 user nova-compute[73158]:   <serial>2d91e3f5-a24e-4ca0-b094-a2caebb98f72</serial>
Aug 17 10:48:51 user nova-compute[73158]: </disk>
Aug 17 10:48:51 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updating instance_info_cache with network_info: [{"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-6c4b0427-a1e6-4a4a-b015-a12453a709f2" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:48:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:48:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:48:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No VIF found with MAC fa:16:3e:cb:b1:43, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:48:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4cddf768-2e43-41d0-9f26-391dacea47fb tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.193s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:53 user nova-compute[73158]: INFO nova.compute.manager [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Terminating instance
Aug 17 10:48:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-b41ba3be-d736-4817-9c1e-f0007e20c6e6 req-dbc06699-897a-4d62-baf9-ec85d8f4ae77 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-vif-unplugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b41ba3be-d736-4817-9c1e-f0007e20c6e6 req-dbc06699-897a-4d62-baf9-ec85d8f4ae77 service nova] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b41ba3be-d736-4817-9c1e-f0007e20c6e6 req-dbc06699-897a-4d62-baf9-ec85d8f4ae77 service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b41ba3be-d736-4817-9c1e-f0007e20c6e6 req-dbc06699-897a-4d62-baf9-ec85d8f4ae77 service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-b41ba3be-d736-4817-9c1e-f0007e20c6e6 req-dbc06699-897a-4d62-baf9-ec85d8f4ae77 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] No waiting events found dispatching network-vif-unplugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.compute.manager [req-b41ba3be-d736-4817-9c1e-f0007e20c6e6 req-dbc06699-897a-4d62-baf9-ec85d8f4ae77 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-vif-unplugged-6541ffa5-e711-4022-946b-a5307449dfdf for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 6c4b0427-a1e6-4a4a-b015-a12453a709f2 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Instance destroyed successfully.
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'resources' on Instance uuid 6c4b0427-a1e6-4a4a-b015-a12453a709f2 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-857713086',display_name='tempest-TestVolumeBootPattern-server-857713086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-857713086',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:47:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-sw11zf31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:47:25Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=6c4b0427-a1e6-4a4a-b015-a12453a709f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "6541ffa5-e711-4022-946b-a5307449dfdf", "address": "fa:16:3e:64:8f:9b", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6541ffa5-e7", "ovs_interfaceid": "6541ffa5-e711-4022-946b-a5307449dfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_vif [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6541ffa5-e7, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:48:54 user nova-compute[73158]: INFO os_vif [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6541ffa5-e711-4022-946b-a5307449dfdf,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6541ffa5-e7')
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDmrwAFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:48:54 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f248d8-1171-4535-8b79-b7c61b51d5b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e076d01-71de-4cf8-adab-be23ef7f00ee]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:48:54 user nova-compute[73158]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)
Aug 17 10:48:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 (non-flash)
Aug 17 10:48:54 user nova-compute[73158]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)
Aug 17 10:48:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c16f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.compute.manager [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Detaching volume 2d91e3f5-a24e-4ca0-b094-a2caebb98f72
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8003bed2-3ee0-4d34-8e62-43a6418c9a0a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[748127c8-0d59-469a-92b8-c60d764fa262]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e46dc-52d5-4ba5-b086-1da280bff06c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.virt.block_device [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attempting to driver detach volume 2d91e3f5-a24e-4ca0-b094-a2caebb98f72 from mountpoint /dev/vdb
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Attempting to detach device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:48:54 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:48:54 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:48:54 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:48:54 user nova-compute[73158]:   <serial>2d91e3f5-a24e-4ca0-b094-a2caebb98f72</serial>
Aug 17 10:48:54 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:48:54 user nova-compute[73158]: </disk>
Aug 17 10:48:54 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config.
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:48:54 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:48:54 user nova-compute[73158]:   <source dev="/dev/sdc"/>
Aug 17 10:48:54 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:48:54 user nova-compute[73158]:   <serial>2d91e3f5-a24e-4ca0-b094-a2caebb98f72</serial>
Aug 17 10:48:54 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:48:54 user nova-compute[73158]: </disk>
Aug 17 10:48:54 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8088e8e-f9d4-4240-8dfe-97bbaa3d7a1a]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c06ebc1c',) {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e4ab2-22bf-4ffb-8cfb-8802f535f3f0]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c7942-3edc-4fa1-9416-431c679ff353]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db934895-2732-4070-8316-d184036ec8c5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260]
Aug 17 10:48:54 user nova-compute[73158]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793, portal: 172.16.0.220,3260] successful.
Aug 17 10:48:54 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d0d5d0-197b-4271-8cac-87fd1304c793 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[31902986-611b-4984-be4e-9b2455fccf88]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== disconnect_volume: return (296ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Deleting instance files /opt/stack/data/nova/instances/6c4b0427-a1e6-4a4a-b015-a12453a709f2_del
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Deletion of /opt/stack/data/nova/instances/6c4b0427-a1e6-4a4a-b015-a12453a709f2_del complete
Aug 17 10:48:54 user nova-compute[73158]: INFO nova.compute.manager [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:48:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692269335.1236007, 93f8e821-eacf-400e-94d4-377bad79a560 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:48:55 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config.
Aug 17 10:48:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMgfyKwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:48:55 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5744f7c8-6104-42ec-a326-c239032ec191]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d54bc4d-395d-4e2f-bda2-fa2f91bf2395]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)
Aug 17 10:48:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 (non-flash)
Aug 17 10:48:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c6e16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d42752c-cb2b-4cc5-b0ed-3543e90d968b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da1c07b-5789-4fc9-aab8-1092d84dcc4e]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd10a26-3ee2-46ad-ae35-9dc6b8a134af]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0835a51-41f5-40d3-8fc9-132a22155840]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[90676309-c30c-4fcb-a839-79b22e6e250f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d66421-f146-4ab7-8030-16d4a505c186]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260]
Aug 17 10:48:55 user nova-compute[73158]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72, portal: 172.16.0.220,3260] successful.
Aug 17 10:48:55 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:55 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Took 0.55 seconds to deallocate network for instance.
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91e3f5-a24e-4ca0-b094-a2caebb98f72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bf7b52-fa19-4e66-9373-cb9e8f88bbd8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== disconnect_volume: return (275ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:48:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-340cdbdf-2687-4ddf-a559-175b4d3f73df req-0bdf8040-81af-41bf-8872-dbacbb985434 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-vif-deleted-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-c92a0f16-8ae6-40a5-a170-0520c7e2acb7 req-94cf9ad6-d559-49ef-9fea-563c27d3b972 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received event network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c92a0f16-8ae6-40a5-a170-0520c7e2acb7 req-94cf9ad6-d559-49ef-9fea-563c27d3b972 service nova] Acquiring lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c92a0f16-8ae6-40a5-a170-0520c7e2acb7 req-94cf9ad6-d559-49ef-9fea-563c27d3b972 service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-c92a0f16-8ae6-40a5-a170-0520c7e2acb7 req-94cf9ad6-d559-49ef-9fea-563c27d3b972 service nova] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG nova.compute.manager [req-c92a0f16-8ae6-40a5-a170-0520c7e2acb7 req-94cf9ad6-d559-49ef-9fea-563c27d3b972 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] No waiting events found dispatching network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:48:56 user nova-compute[73158]: WARNING nova.compute.manager [req-c92a0f16-8ae6-40a5-a170-0520c7e2acb7 req-94cf9ad6-d559-49ef-9fea-563c27d3b972 service nova] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Received unexpected event network-vif-plugged-6541ffa5-e711-4022-946b-a5307449dfdf for instance with vm_state active and task_state deleting.
Aug 17 10:48:56 user nova-compute[73158]: INFO nova.compute.manager [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Took 1.07 seconds to detach 1 volumes for instance.
Aug 17 10:48:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Deleting volume: d1d0d5d0-197b-4271-8cac-87fd1304c793 {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:56 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Deleted allocations for instance 6c4b0427-a1e6-4a4a-b015-a12453a709f2
Aug 17 10:48:56 user nova-compute[73158]: DEBUG nova.objects.instance [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8080cb9e-55b5-4751-b62c-a28c1ccae68d tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.437s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:48:56 user nova-compute[73158]: INFO nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "6c4b0427-a1e6-4a4a-b015-a12453a709f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.003s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-281e72d0-bbe8-44c7-81a3-ecb32d3a8e2e tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.325s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:48:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:48:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:00 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:49:01 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:49:01 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=24.14093017578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:49:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:49:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269334.4207482, 6c4b0427-a1e6-4a4a-b015-a12453a709f2 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:49:09 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] VM Stopped (Lifecycle Event)
Aug 17 10:49:09 user nova-compute[73158]: DEBUG nova.compute.manager [None req-a9ff19e8-1924-41dc-a563-f9d92973cc8f None None] [instance: 6c4b0427-a1e6-4a4a-b015-a12453a709f2] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:49:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:49:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:49:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:49:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:49:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:49:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:49:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:49:48 user nova-compute[73158]: INFO nova.compute.manager [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attaching volume e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 to /dev/vdb
Aug 17 10:49:48 user nova-compute[73158]: DEBUG os_brick.utils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[704b6728-7a77-42c1-a27d-b048cec1b6f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd58794-548d-415e-b12b-1489dcb519c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[750621bb-3d63-4735-b1f3-d56abe39df57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc7d2b6-10f2-40d2-999c-f2bb3de74757]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:49:48 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:49:48 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[314bf4b9-2077-40b5-81c7-d6d41751d74e]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG os_brick.utils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:49:48 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating existing volume attachment record: e9cf1c86-0436-4a13-8a4f-7fbda8ffeef4 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:49:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:49:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:49:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:49:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:49:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:49:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:01 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:50:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=24.13977813720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:50:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:50:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuaDcONZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:50:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:50:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:50:10 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb99b1-430e-416f-a8ab-160a6149e45e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:50:10 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[260c4503-b0ac-4604-8bdb-83a7c6482103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0] added
Aug 17 10:50:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[089156b4-cc5a-4421-886e-030cae72321f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ef5753-40a7-4ae0-849b-ed2b9d744199]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuaDcONZ {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuaDcONZ" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c4554-a356-405d-a396-8d4d3275d78c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BuaDcONZ'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[227fe4df-fffc-4e0c-b514-7f89548bfaba]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d3d2b5-1d61-4d63-9c35-2642ef515e29]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:50:10 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:50:10 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:50:10 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:50:10 user nova-compute[73158]: 
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[316fde17-49c0-4e11-a510-f1a3159607f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260]
Aug 17 10:50:10 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260] successful.
Aug 17 10:50:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[87358d6d-fe6c-47c2-8c93-fc4bf2384e8f]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d55ff-e9b2-4446-b562-8dd5fb6ce670]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 (non-flash)
Aug 17 10:50:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 (non-flash)
Aug 17 10:50:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba54e7e-2d19-4941-ab78-4edc364b49d1]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:50:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuaDcONZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:50:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:50:11 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26636616532623834', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:50:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636616532623834', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:50:11 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:50:11 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 10:50:11 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:50:11 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:50:11 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:50:11 user nova-compute[73158]:   <serial>e419db2f-fc75-4556-8ca0-2bf2e99aa1e0</serial>
Aug 17 10:50:11 user nova-compute[73158]: </disk>
Aug 17 10:50:11 user nova-compute[73158]:  {{(pid=73158) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 10:50:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:50:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:50:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] No VIF found with MAC fa:16:3e:cb:b1:43, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:50:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c75b6be1-5f4b-4399-b453-a835fd946589 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.569s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:14 user nova-compute[73158]: INFO nova.compute.manager [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Detaching volume e419db2f-fc75-4556-8ca0-2bf2e99aa1e0
Aug 17 10:50:15 user nova-compute[73158]: INFO nova.virt.block_device [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Attempting to driver detach volume e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 from mountpoint /dev/vdb
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Attempting to detach device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config. {{(pid=73158) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:50:15 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:50:15 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:50:15 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:50:15 user nova-compute[73158]:   <serial>e419db2f-fc75-4556-8ca0-2bf2e99aa1e0</serial>
Aug 17 10:50:15 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:50:15 user nova-compute[73158]: </disk>
Aug 17 10:50:15 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:50:15 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the persistent domain config.
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config. {{(pid=73158) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.guest [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 10:50:15 user nova-compute[73158]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:50:15 user nova-compute[73158]:   <source dev="/dev/sdb"/>
Aug 17 10:50:15 user nova-compute[73158]:   <target dev="vdb" bus="virtio"/>
Aug 17 10:50:15 user nova-compute[73158]:   <serial>e419db2f-fc75-4556-8ca0-2bf2e99aa1e0</serial>
Aug 17 10:50:15 user nova-compute[73158]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 10:50:15 user nova-compute[73158]: </disk>
Aug 17 10:50:15 user nova-compute[73158]:  {{(pid=73158) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Received event <DeviceRemovedEvent: 1692269415.4862633, 93f8e821-eacf-400e-94d4-377bad79a560 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73158) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 10:50:15 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully detached device vdb from instance 93f8e821-eacf-400e-94d4-377bad79a560 from the live domain config.
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuaDcONZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:50:15 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca9d937-c7d4-4fdb-935a-20eecca18ce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a944b-e60c-4614-8076-f1faa4ecc376]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 (non-flash)
Aug 17 10:50:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 (non-flash)
Aug 17 10:50:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0456d68-10d2-4992-bd6e-2c45bdfbe68f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[059eca98-9ac3-4265-b847-b4988acd5162]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2516b-f1f5-41fd-83b5-815492b15103]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b5ae4-ad8e-42e7-ae6a-14a210d230af]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0847c813-2d03-4f4d-b28a-c2e324177df7]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f936073e-d1f5-4cca-9cb1-cf2361eca778]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260]
Aug 17 10:50:15 user nova-compute[73158]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0, portal: 172.16.0.220,3260] successful.
Aug 17 10:50:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e419db2f-fc75-4556-8ca0-2bf2e99aa1e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcf09bc-0893-4858-8849-a4411d177a20]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] <== disconnect_volume: return (263ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:50:16 user nova-compute[73158]: INFO nova.compute.claims [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Claim successful on node user
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.network.neutron [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:50:16 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:50:16 user nova-compute[73158]: INFO nova.virt.block_device [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Booting with volume b35d7571-ace1-4085-b605-374120c2ca73 at /dev/vda
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.policy [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d339d632dc04d9996c284a37269ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b44dd2b2840f19d651e921cb73ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG os_brick.utils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5873584a-a8db-41a9-b41a-319fc3f448a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b6464-f3f9-45e9-8456-5073432cc440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8dce03-9c45-4531-83e0-c9bb7f502fd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'flavor' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf316f-08b3-44e0-b5ad-11dcbcf21f94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:50:16 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[af001943-43ff-438d-b016-ddb8729d9d22]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG os_brick.utils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating existing volume attachment record: fbe03546-5584-4d30-b4fa-455d3436e17e {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:50:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-aa2df9a6-a5ca-4832-8d40-f9d80e189873 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:17 user nova-compute[73158]: DEBUG nova.network.neutron [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Successfully created port: 5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:50:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Successfully updated port: 5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquired lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-changed-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.compute.manager [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Refreshing instance network info cache due to event network-changed-5927a600-0b16-40f6-9fbc-a0652bede7bd. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] Acquiring lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.network.neutron [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Releasing lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Instance network_info: |[{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] Acquired lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:50:18 user nova-compute[73158]: DEBUG nova.network.neutron [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Refreshing network info cache for port 5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:50:19 user nova-compute[73158]: DEBUG nova.network.neutron [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updated VIF entry in instance network info cache for port 5927a600-0b16-40f6-9fbc-a0652bede7bd. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:50:19 user nova-compute[73158]: DEBUG nova.network.neutron [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:50:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-22c899b0-4184-4d05-8903-e1ef3f968400 req-1833b2ef-977c-41dd-a05e-63e75afd7d23 service nova] Releasing lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:50:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:50:26 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Creating image(s)
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Ensure instance console log exists: /opt/stack/data/nova/instances/63a3094d-f43d-45cc-8563-8b73122e18a0/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Start _get_guest_xml network_info=[{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'fbe03546-5584-4d30-b4fa-455d3436e17e', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVZJgMvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63a3094d-f43d-45cc-8563-8b73122e18a0', 'attached_at': '', 'detached_at': '', 'volume_id': 'b35d7571-ace1-4085-b605-374120c2ca73', 'serial': 'b35d7571-ace1-4085-b605-374120c2ca73'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:50:26 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:50:26 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVZJgMvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:50:26 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:50:26 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:50:26 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28192ded-2b9d-439c-aa49-c6cbd0e0f9c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:50:26 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7f4b28-7c08-4e7d-976d-8670e3fc191f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73] added
Aug 17 10:50:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8360ff0e-bfb0-46fb-860f-8aed2ed244c3]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e0d959-a302-4d2d-b590-8ed6b57c832a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVZJgMvP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVZJgMvP" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc6c05d-38a6-4c13-b0b7-5b68ea137835]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVZJgMvP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ae97b-be4e-4c02-a782-89b860e6e7cc]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a3a99-db54-4750-9f16-1e5cc4a379b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:50:26 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:50:26 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:50:26 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:50:26 user nova-compute[73158]: 
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a1323-70ed-4d39-a195-30717e167e82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260]
Aug 17 10:50:26 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260] successful.
Aug 17 10:50:26 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b731f8a2-c1c0-4167-8d98-cd5965b60409]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:50:26 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[459096e0-d6d4-46ec-a910-a9b2f00d652a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:50:27 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:50:27 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e6ff9c-345c-4720-ba35-3ab7c3128255]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:50:27 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVZJgMvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23338313766646533', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338313766646533', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-280708008',display_name='tempest-TestVolumeBootPattern-volume-backed-server-280708008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-280708008',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBIFkrnmcAmU1wBorK1hVMkrUWAu6479sqTC9qjLoBY0WDsZcW0wvjy0qR9oLyTCiZQKpMPWUKLUUx8s2yWH9/IGn6en3N8lW1MGBSIQoLp76cn/ePSlBbfSES6KhYkpw==',key_name='tempest-keypair-1971407893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-uy6j0xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d339d632dc04d9996c284a37269ee55',uuid=63a3094d-f43d-45cc-8563-8b73122e18a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.objects.instance [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'pci_devices' on Instance uuid 63a3094d-f43d-45cc-8563-8b73122e18a0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:50:28 user nova-compute[73158]:   <uuid>63a3094d-f43d-45cc-8563-8b73122e18a0</uuid>
Aug 17 10:50:28 user nova-compute[73158]:   <name>instance-00000030</name>
Aug 17 10:50:28 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:50:28 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:50:28 user nova-compute[73158]:   <metadata>
Aug 17 10:50:28 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:50:28 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:50:28 user nova-compute[73158]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-280708008</nova:name>
Aug 17 10:50:28 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:50:26</nova:creationTime>
Aug 17 10:50:28 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:50:28 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:50:28 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:50:28 user nova-compute[73158]:       <nova:owner>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:user uuid="9d339d632dc04d9996c284a37269ee55">tempest-TestVolumeBootPattern-1100093910-project-member</nova:user>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:project uuid="356b44dd2b2840f19d651e921cb73ba7">tempest-TestVolumeBootPattern-1100093910</nova:project>
Aug 17 10:50:28 user nova-compute[73158]:       </nova:owner>
Aug 17 10:50:28 user nova-compute[73158]:       <nova:ports>
Aug 17 10:50:28 user nova-compute[73158]:         <nova:port uuid="5927a600-0b16-40f6-9fbc-a0652bede7bd">
Aug 17 10:50:28 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 10:50:28 user nova-compute[73158]:         </nova:port>
Aug 17 10:50:28 user nova-compute[73158]:       </nova:ports>
Aug 17 10:50:28 user nova-compute[73158]:     </nova:instance>
Aug 17 10:50:28 user nova-compute[73158]:   </metadata>
Aug 17 10:50:28 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:50:28 user nova-compute[73158]:     <system>
Aug 17 10:50:28 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:50:28 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:50:28 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:50:28 user nova-compute[73158]:       <entry name="serial">63a3094d-f43d-45cc-8563-8b73122e18a0</entry>
Aug 17 10:50:28 user nova-compute[73158]:       <entry name="uuid">63a3094d-f43d-45cc-8563-8b73122e18a0</entry>
Aug 17 10:50:28 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:50:28 user nova-compute[73158]:     </system>
Aug 17 10:50:28 user nova-compute[73158]:   </sysinfo>
Aug 17 10:50:28 user nova-compute[73158]:   <os>
Aug 17 10:50:28 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:50:28 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:50:28 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:50:28 user nova-compute[73158]:   </os>
Aug 17 10:50:28 user nova-compute[73158]:   <features>
Aug 17 10:50:28 user nova-compute[73158]:     <acpi/>
Aug 17 10:50:28 user nova-compute[73158]:     <apic/>
Aug 17 10:50:28 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:50:28 user nova-compute[73158]:   </features>
Aug 17 10:50:28 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:50:28 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:50:28 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:50:28 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:50:28 user nova-compute[73158]:   </clock>
Aug 17 10:50:28 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:50:28 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:50:28 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:50:28 user nova-compute[73158]:   </cpu>
Aug 17 10:50:28 user nova-compute[73158]:   <devices>
Aug 17 10:50:28 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:50:28 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:50:28 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:50:28 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:50:28 user nova-compute[73158]:       <serial>b35d7571-ace1-4085-b605-374120c2ca73</serial>
Aug 17 10:50:28 user nova-compute[73158]:     </disk>
Aug 17 10:50:28 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:50:28 user nova-compute[73158]:       <mac address="fa:16:3e:e3:d8:c0"/>
Aug 17 10:50:28 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:50:28 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:50:28 user nova-compute[73158]:       <target dev="tap5927a600-0b"/>
Aug 17 10:50:28 user nova-compute[73158]:     </interface>
Aug 17 10:50:28 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:50:28 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/63a3094d-f43d-45cc-8563-8b73122e18a0/console.log" append="off"/>
Aug 17 10:50:28 user nova-compute[73158]:     </serial>
Aug 17 10:50:28 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:50:28 user nova-compute[73158]:     <video>
Aug 17 10:50:28 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:50:28 user nova-compute[73158]:     </video>
Aug 17 10:50:28 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:50:28 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:50:28 user nova-compute[73158]:     </rng>
Aug 17 10:50:28 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:50:28 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:50:28 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:50:28 user nova-compute[73158]:     </memballoon>
Aug 17 10:50:28 user nova-compute[73158]:   </devices>
Aug 17 10:50:28 user nova-compute[73158]: </domain>
Aug 17 10:50:28 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-280708008',display_name='tempest-TestVolumeBootPattern-volume-backed-server-280708008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-280708008',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBIFkrnmcAmU1wBorK1hVMkrUWAu6479sqTC9qjLoBY0WDsZcW0wvjy0qR9oLyTCiZQKpMPWUKLUUx8s2yWH9/IGn6en3N8lW1MGBSIQoLp76cn/ePSlBbfSES6KhYkpw==',key_name='tempest-keypair-1971407893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-uy6j0xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d339d632dc04d9996c284a37269ee55',uuid=63a3094d-f43d-45cc-8563-8b73122e18a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG os_vif [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5927a600-0b, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5927a600-0b, col_values=(('external_ids', {'iface-id': '5927a600-0b16-40f6-9fbc-a0652bede7bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:d8:c0', 'vm-uuid': '63a3094d-f43d-45cc-8563-8b73122e18a0'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:28 user nova-compute[73158]: INFO os_vif [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b')
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:50:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No VIF found with MAC fa:16:3e:e3:d8:c0, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-4ec3cafd-0f86-4e5f-94e5-3ece1c0239a0 req-b67afeaf-7da7-4791-947f-4b7a1cd2ff6d service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4ec3cafd-0f86-4e5f-94e5-3ece1c0239a0 req-b67afeaf-7da7-4791-947f-4b7a1cd2ff6d service nova] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4ec3cafd-0f86-4e5f-94e5-3ece1c0239a0 req-b67afeaf-7da7-4791-947f-4b7a1cd2ff6d service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4ec3cafd-0f86-4e5f-94e5-3ece1c0239a0 req-b67afeaf-7da7-4791-947f-4b7a1cd2ff6d service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG nova.compute.manager [req-4ec3cafd-0f86-4e5f-94e5-3ece1c0239a0 req-b67afeaf-7da7-4791-947f-4b7a1cd2ff6d service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] No waiting events found dispatching network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:50:29 user nova-compute[73158]: WARNING nova.compute.manager [req-4ec3cafd-0f86-4e5f-94e5-3ece1c0239a0 req-b67afeaf-7da7-4791-947f-4b7a1cd2ff6d service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received unexpected event network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd for instance with vm_state building and task_state spawning.
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269431.411757, 63a3094d-f43d-45cc-8563-8b73122e18a0 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] VM Resumed (Lifecycle Event)
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Instance spawned successfully.
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269431.4130242, 63a3094d-f43d-45cc-8563-8b73122e18a0 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] VM Started (Lifecycle Event)
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Took 4.83 seconds to spawn the instance on the hypervisor.
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:50:31 user nova-compute[73158]: INFO nova.compute.manager [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Took 15.55 seconds to build instance.
Aug 17 10:50:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-1072cfb3-3577-479d-84d2-43e986b23c2f tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.637s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [req-941aca5b-5c22-4adf-89dc-a386aaf88329 req-bf559b0e-7574-4c21-af8d-8831dacb8a17 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-941aca5b-5c22-4adf-89dc-a386aaf88329 req-bf559b0e-7574-4c21-af8d-8831dacb8a17 service nova] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-941aca5b-5c22-4adf-89dc-a386aaf88329 req-bf559b0e-7574-4c21-af8d-8831dacb8a17 service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-941aca5b-5c22-4adf-89dc-a386aaf88329 req-bf559b0e-7574-4c21-af8d-8831dacb8a17 service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:50:31 user nova-compute[73158]: DEBUG nova.compute.manager [req-941aca5b-5c22-4adf-89dc-a386aaf88329 req-bf559b0e-7574-4c21-af8d-8831dacb8a17 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] No waiting events found dispatching network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:50:31 user nova-compute[73158]: WARNING nova.compute.manager [req-941aca5b-5c22-4adf-89dc-a386aaf88329 req-bf559b0e-7574-4c21-af8d-8831dacb8a17 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received unexpected event network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd for instance with vm_state active and task_state None.
Aug 17 10:50:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:50:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:50:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:50:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:50:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:50 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:50:51 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:50:52 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [{"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:50:52 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-93f8e821-eacf-400e-94d4-377bad79a560" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:50:52 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:50:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:50:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:50:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:50:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:51:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:03 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:51:03 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=24.13753890991211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 93f8e821-eacf-400e-94d4-377bad79a560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 63a3094d-f43d-45cc-8563-8b73122e18a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:51:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:51:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:51:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:51:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:51:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:51:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:51 user nova-compute[73158]: INFO nova.compute.manager [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Terminating instance
Aug 17 10:51:51 user nova-compute[73158]: DEBUG nova.compute.manager [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-39eb69f5-dc17-4b4d-ad92-bbcaea26be93 req-fb0aa1a1-e998-4091-9496-5848537039ef service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-vif-unplugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-39eb69f5-dc17-4b4d-ad92-bbcaea26be93 req-fb0aa1a1-e998-4091-9496-5848537039ef service nova] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-39eb69f5-dc17-4b4d-ad92-bbcaea26be93 req-fb0aa1a1-e998-4091-9496-5848537039ef service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-39eb69f5-dc17-4b4d-ad92-bbcaea26be93 req-fb0aa1a1-e998-4091-9496-5848537039ef service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-39eb69f5-dc17-4b4d-ad92-bbcaea26be93 req-fb0aa1a1-e998-4091-9496-5848537039ef service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] No waiting events found dispatching network-vif-unplugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG nova.compute.manager [req-39eb69f5-dc17-4b4d-ad92-bbcaea26be93 req-fb0aa1a1-e998-4091-9496-5848537039ef service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-vif-unplugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:51:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Instance destroyed successfully.
Aug 17 10:51:52 user nova-compute[73158]: DEBUG nova.objects.instance [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lazy-loading 'resources' on Instance uuid 93f8e821-eacf-400e-94d4-377bad79a560 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-831802436',display_name='tempest-SnapshotDataIntegrityTests-server-831802436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-831802436',id=46,image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI276mRPaxTkQ7zIgn6p7Tz36/4LxI9NBakq90srDQJrnN//8UqkZ9BuCn56it828BKZI44JXxstvMQNf89lwPR8JF4xKvYt/75W88KMWT//IrdXEcqI5swfYAtCCYW7Xg==',key_name='tempest-keypair-852897710',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:44:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb6a9281a3f44042a8d3e1448784314c',ramdisk_id='',reservation_id='r-ml324e1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b73e703-52fe-4fe4-ae2e-19e6c25bad78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-206485675',owner_user_name='tempest-SnapshotDataIntegrityTests-206485675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f99e22043434486a68dcc2a27e460b1',uuid=93f8e821-eacf-400e-94d4-377bad79a560,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Converting VIF {"id": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "address": "fa:16:3e:cb:b1:43", "network": {"id": "41596d7e-f710-4273-9eef-f6c465801731", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1215585317-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb6a9281a3f44042a8d3e1448784314c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36b765a-ec", "ovs_interfaceid": "d36b765a-ecdb-49ca-a4ff-8ab67917ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG os_vif [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd36b765a-ec, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:51:52 user nova-compute[73158]: INFO os_vif [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:b1:43,bridge_name='br-int',has_traffic_filtering=True,id=d36b765a-ecdb-49ca-a4ff-8ab67917ebc8,network=Network(41596d7e-f710-4273-9eef-f6c465801731),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36b765a-ec')
Aug 17 10:51:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Deleting instance files /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560_del
Aug 17 10:51:52 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Deletion of /opt/stack/data/nova/instances/93f8e821-eacf-400e-94d4-377bad79a560_del complete
Aug 17 10:51:52 user nova-compute[73158]: INFO nova.compute.manager [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 10:51:52 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:51:53 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Took 1.13 seconds to deallocate network for instance.
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:53 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Deleted allocations for instance 93f8e821-eacf-400e-94d4-377bad79a560
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-0caf2fed-3e0c-45a8-82c6-646364819931 tempest-SnapshotDataIntegrityTests-206485675 tempest-SnapshotDataIntegrityTests-206485675-project-member] Lock "93f8e821-eacf-400e-94d4-377bad79a560" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] Acquiring lock "93f8e821-eacf-400e-94d4-377bad79a560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] Lock "93f8e821-eacf-400e-94d4-377bad79a560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] No waiting events found dispatching network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:51:53 user nova-compute[73158]: WARNING nova.compute.manager [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received unexpected event network-vif-plugged-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 for instance with vm_state deleted and task_state None.
Aug 17 10:51:53 user nova-compute[73158]: DEBUG nova.compute.manager [req-4f189fb9-784a-4acb-82f1-dfa818354b0f req-297d0bbf-3390-4824-b739-b709ae409d03 service nova] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Received event network-vif-deleted-d36b765a-ecdb-49ca-a4ff-8ab67917ebc8 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:51:54 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:51:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:51:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:51:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:51:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:51:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:51:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:52:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:52:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:52:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=24.15671157836914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 63a3094d-f43d-45cc-8563-8b73122e18a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:52:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:52:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:52:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:52:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:52:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269512.2082973, 93f8e821-eacf-400e-94d4-377bad79a560 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:52:07 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] VM Stopped (Lifecycle Event)
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.compute.manager [None req-54c1189b-c38d-41ff-bff5-943fca679cad None None] [instance: 93f8e821-eacf-400e-94d4-377bad79a560] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-changed-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Refreshing instance network info cache due to event network-changed-5927a600-0b16-40f6-9fbc-a0652bede7bd. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] Acquiring lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] Acquired lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Refreshing network info cache for port 5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updated VIF entry in instance network info cache for port 5927a600-0b16-40f6-9fbc-a0652bede7bd. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG nova.network.neutron [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:52:07 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-383fdc89-fbbd-4f54-b3a7-15b9bcbfc743 req-dd3efce3-236b-4d5c-b8ea-7833af82708a service nova] Releasing lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:52:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:52:19 user nova-compute[73158]: INFO nova.compute.claims [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Claim successful on node user
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:52:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:52:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:52:20 user nova-compute[73158]: INFO nova.virt.block_device [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Booting with volume snapshot b1f2d7b0-e630-458d-8e7b-5c978fddc6a5 at /dev/vda
Aug 17 10:52:20 user nova-compute[73158]: DEBUG nova.policy [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d339d632dc04d9996c284a37269ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b44dd2b2840f19d651e921cb73ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:52:20 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Successfully created port: d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Successfully updated port: d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquired lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-changed-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.compute.manager [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Refreshing instance network info cache due to event network-changed-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] Acquiring lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.network.neutron [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updating instance_info_cache with network_info: [{"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Releasing lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Instance network_info: |[{"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] Acquired lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:52:21 user nova-compute[73158]: DEBUG nova.network.neutron [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Refreshing network info cache for port d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:52:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:22 user nova-compute[73158]: DEBUG nova.network.neutron [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updated VIF entry in instance network info cache for port d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:52:22 user nova-compute[73158]: DEBUG nova.network.neutron [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updating instance_info_cache with network_info: [{"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:52:22 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-b12ff031-b31c-4c0a-8c58-029d4ac1f60b req-aafc55be-4734-4211-bc46-c88fcee40904 service nova] Releasing lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:52:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG os_brick.utils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[10907214-1a4e-42f6-be20-7fcc1087cbb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683d2de-299b-4dbe-a37d-95d753d53602]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbdf23d-0583-43bb-8d71-2711fe5f687b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe10bf4-bc31-4c6c-ab45-887960cec3bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:52:25 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:52:25 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949302e-edca-41a9-bb6d-46b346b7c981]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG os_brick.utils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:52:25 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updating existing volume attachment record: 374ac7da-7ca7-4e3d-b2cd-964461ee0486 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:52:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:52:36 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Creating image(s)
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Ensure instance console log exists: /opt/stack/data/nova/instances/6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Start _get_guest_xml network_info=[{"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T10:52:09Z,direct_url=<?>,disk_format='qcow2',id=8769b436-2f27-4608-8705-b50cd12bcabf,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1666722945',owner='356b44dd2b2840f19d651e921cb73ba7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T10:52:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '374ac7da-7ca7-4e3d-b2cd-964461ee0486', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOmcvTZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'c66fcc75-d078-45b5-b6e4-df40aca7999b', 'serial': 'c66fcc75-d078-45b5-b6e4-df40aca7999b'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:52:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:52:36 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T10:52:09Z,direct_url=<?>,disk_format='qcow2',id=8769b436-2f27-4608-8705-b50cd12bcabf,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1666722945',owner='356b44dd2b2840f19d651e921cb73ba7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T10:52:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOmcvTZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:52:36 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:52:36 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:52:36 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb05b52f-3f26-4396-8f18-abdf3b93e497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:52:36 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92ba67-3596-4aed-b230-ee44ebb798a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b] added
Aug 17 10:52:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae3d82-cd0e-4c94-8cca-f098c6333b07]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8286a0f0-1190-4b0c-a9c5-0d45ca996eb4]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOmcvTZy {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOmcvTZy" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7975b28-1cfb-404d-9cd9-e916356f0a8a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lOmcvTZy'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f64d04-04cd-4ec2-b540-ef0989bed674]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c8b86-89f8-45e6-8c84-67f5542a7bf0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:52:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:52:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c9617-172b-4d0a-9e3e-52b83d20942a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260]
Aug 17 10:52:36 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260] successful.
Aug 17 10:52:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[542e6a8d-d29c-406d-9495-b51d49451370]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7bae48-c5b1-4daf-a79e-27344b3d2570]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:52:36 user nova-compute[73158]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b (non-flash)
Aug 17 10:52:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:52:36 user nova-compute[73158]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b (non-flash)
Aug 17 10:52:36 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8acecc1-2bc2-46bd-a9b2-e408e60b85f5]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:52:36 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOmcvTZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23962333735616363', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962333735616363', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:52:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1366138078',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1366138078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1366138078',id=49,image_ref='8769b436-2f27-4608-8705-b50cd12bcabf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfjagh/th2hLhag66t8L7vYuelc/BHbQTnqm5B+I9xnavF1cAHTvDwJ7vGW8tyYTAgtd92kyrRcX/Lgp9f30ssFQhpmgF2+QIE77cmXGW2r/ehZAwQZ3lfod+jEMJoOBA==',key_name='tempest-keypair-216473515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-9z4blqbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1100093910',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d339d632dc04d9996c284a37269ee55',uuid=6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.objects.instance [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:52:37 user nova-compute[73158]:   <uuid>6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca</uuid>
Aug 17 10:52:37 user nova-compute[73158]:   <name>instance-00000031</name>
Aug 17 10:52:37 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:52:37 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:52:37 user nova-compute[73158]:   <metadata>
Aug 17 10:52:37 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:52:37 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:52:37 user nova-compute[73158]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1366138078</nova:name>
Aug 17 10:52:37 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:52:36</nova:creationTime>
Aug 17 10:52:37 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:52:37 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:52:37 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:52:37 user nova-compute[73158]:       <nova:owner>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:user uuid="9d339d632dc04d9996c284a37269ee55">tempest-TestVolumeBootPattern-1100093910-project-member</nova:user>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:project uuid="356b44dd2b2840f19d651e921cb73ba7">tempest-TestVolumeBootPattern-1100093910</nova:project>
Aug 17 10:52:37 user nova-compute[73158]:       </nova:owner>
Aug 17 10:52:37 user nova-compute[73158]:       <nova:root type="image" uuid="8769b436-2f27-4608-8705-b50cd12bcabf"/>
Aug 17 10:52:37 user nova-compute[73158]:       <nova:ports>
Aug 17 10:52:37 user nova-compute[73158]:         <nova:port uuid="d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1">
Aug 17 10:52:37 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 10:52:37 user nova-compute[73158]:         </nova:port>
Aug 17 10:52:37 user nova-compute[73158]:       </nova:ports>
Aug 17 10:52:37 user nova-compute[73158]:     </nova:instance>
Aug 17 10:52:37 user nova-compute[73158]:   </metadata>
Aug 17 10:52:37 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:52:37 user nova-compute[73158]:     <system>
Aug 17 10:52:37 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:52:37 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:52:37 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:52:37 user nova-compute[73158]:       <entry name="serial">6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca</entry>
Aug 17 10:52:37 user nova-compute[73158]:       <entry name="uuid">6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca</entry>
Aug 17 10:52:37 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:52:37 user nova-compute[73158]:     </system>
Aug 17 10:52:37 user nova-compute[73158]:   </sysinfo>
Aug 17 10:52:37 user nova-compute[73158]:   <os>
Aug 17 10:52:37 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:52:37 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:52:37 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:52:37 user nova-compute[73158]:   </os>
Aug 17 10:52:37 user nova-compute[73158]:   <features>
Aug 17 10:52:37 user nova-compute[73158]:     <acpi/>
Aug 17 10:52:37 user nova-compute[73158]:     <apic/>
Aug 17 10:52:37 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:52:37 user nova-compute[73158]:   </features>
Aug 17 10:52:37 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:52:37 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:52:37 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:52:37 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:52:37 user nova-compute[73158]:   </clock>
Aug 17 10:52:37 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:52:37 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:52:37 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:52:37 user nova-compute[73158]:   </cpu>
Aug 17 10:52:37 user nova-compute[73158]:   <devices>
Aug 17 10:52:37 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:52:37 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:52:37 user nova-compute[73158]:       <source dev="/dev/sdc"/>
Aug 17 10:52:37 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:52:37 user nova-compute[73158]:       <serial>c66fcc75-d078-45b5-b6e4-df40aca7999b</serial>
Aug 17 10:52:37 user nova-compute[73158]:     </disk>
Aug 17 10:52:37 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:52:37 user nova-compute[73158]:       <mac address="fa:16:3e:74:30:40"/>
Aug 17 10:52:37 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:52:37 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:52:37 user nova-compute[73158]:       <target dev="tapd7ae3f94-e7"/>
Aug 17 10:52:37 user nova-compute[73158]:     </interface>
Aug 17 10:52:37 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:52:37 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca/console.log" append="off"/>
Aug 17 10:52:37 user nova-compute[73158]:     </serial>
Aug 17 10:52:37 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:52:37 user nova-compute[73158]:     <video>
Aug 17 10:52:37 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:52:37 user nova-compute[73158]:     </video>
Aug 17 10:52:37 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:52:37 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:52:37 user nova-compute[73158]:     </rng>
Aug 17 10:52:37 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:52:37 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:52:37 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:52:37 user nova-compute[73158]:     </memballoon>
Aug 17 10:52:37 user nova-compute[73158]:   </devices>
Aug 17 10:52:37 user nova-compute[73158]: </domain>
Aug 17 10:52:37 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:52:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1366138078',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1366138078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1366138078',id=49,image_ref='8769b436-2f27-4608-8705-b50cd12bcabf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfjagh/th2hLhag66t8L7vYuelc/BHbQTnqm5B+I9xnavF1cAHTvDwJ7vGW8tyYTAgtd92kyrRcX/Lgp9f30ssFQhpmgF2+QIE77cmXGW2r/ehZAwQZ3lfod+jEMJoOBA==',key_name='tempest-keypair-216473515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-9z4blqbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1100093910',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d339d632dc04d9996c284a37269ee55',uuid=6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG os_vif [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7ae3f94-e7, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7ae3f94-e7, col_values=(('external_ids', {'iface-id': 'd7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:30:40', 'vm-uuid': '6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:37 user nova-compute[73158]: INFO os_vif [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7')
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:52:37 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No VIF found with MAC fa:16:3e:74:30:40, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-4f70e195-021d-4d31-9947-6a6fb81b551e req-809a1ea4-2d17-4812-9f6c-ae516757e9cc service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4f70e195-021d-4d31-9947-6a6fb81b551e req-809a1ea4-2d17-4812-9f6c-ae516757e9cc service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4f70e195-021d-4d31-9947-6a6fb81b551e req-809a1ea4-2d17-4812-9f6c-ae516757e9cc service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-4f70e195-021d-4d31-9947-6a6fb81b551e req-809a1ea4-2d17-4812-9f6c-ae516757e9cc service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG nova.compute.manager [req-4f70e195-021d-4d31-9947-6a6fb81b551e req-809a1ea4-2d17-4812-9f6c-ae516757e9cc service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:52:38 user nova-compute[73158]: WARNING nova.compute.manager [req-4f70e195-021d-4d31-9947-6a6fb81b551e req-809a1ea4-2d17-4812-9f6c-ae516757e9cc service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received unexpected event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with vm_state building and task_state spawning.
Aug 17 10:52:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269560.9062185, 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:52:40 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] VM Resumed (Lifecycle Event)
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:52:40 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Instance spawned successfully.
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:52:40 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269560.907544, 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:52:40 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] VM Started (Lifecycle Event)
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:52:40 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:52:41 user nova-compute[73158]: INFO nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 17 10:52:41 user nova-compute[73158]: DEBUG nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:52:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-8e5c8451-2ee6-46f5-80ca-c7839f78b473 req-8af2a305-e9ed-4ce0-9ecb-3f2d4c8d8fea service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:52:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8e5c8451-2ee6-46f5-80ca-c7839f78b473 req-8af2a305-e9ed-4ce0-9ecb-3f2d4c8d8fea service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:52:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8e5c8451-2ee6-46f5-80ca-c7839f78b473 req-8af2a305-e9ed-4ce0-9ecb-3f2d4c8d8fea service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:52:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-8e5c8451-2ee6-46f5-80ca-c7839f78b473 req-8af2a305-e9ed-4ce0-9ecb-3f2d4c8d8fea service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:41 user nova-compute[73158]: DEBUG nova.compute.manager [req-8e5c8451-2ee6-46f5-80ca-c7839f78b473 req-8af2a305-e9ed-4ce0-9ecb-3f2d4c8d8fea service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:52:41 user nova-compute[73158]: WARNING nova.compute.manager [req-8e5c8451-2ee6-46f5-80ca-c7839f78b473 req-8af2a305-e9ed-4ce0-9ecb-3f2d4c8d8fea service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received unexpected event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with vm_state building and task_state spawning.
Aug 17 10:52:41 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:52:41 user nova-compute[73158]: INFO nova.compute.manager [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Took 21.48 seconds to build instance.
Aug 17 10:52:41 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-2827c5a1-04d8-466c-9e56-195dd4a4f93a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.575s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:52:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:45 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:52:53 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 63a3094d-f43d-45cc-8563-8b73122e18a0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:52:54 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:52:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:52:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:52:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:52:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:52:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:53:02 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:53:02 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8634MB free_disk=24.153858184814453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:53:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 63a3094d-f43d-45cc-8563-8b73122e18a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:53:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:53:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:12 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:53:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:53:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:53:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:53:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:53:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:53:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:53:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:51 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:53:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updating instance_info_cache with network_info: [{"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:53:54 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:53:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:53:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:53:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:53:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:53:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:53:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:54:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:54:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:54:03 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:54:03 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:54:03 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=24.153209686279297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 63a3094d-f43d-45cc-8563-8b73122e18a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:54:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:54:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-changed-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Refreshing instance network info cache due to event network-changed-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:54:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] Acquiring lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:54:10 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] Acquired lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:54:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Refreshing network info cache for port d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.network.neutron [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updated VIF entry in instance network info cache for port d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.network.neutron [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updating instance_info_cache with network_info: [{"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-ed3612a4-3b0c-4e42-8fb7-36c70705c265 req-282cac89-d85b-4aec-8398-58942bb0f29e service nova] Releasing lock "refresh_cache-6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:12 user nova-compute[73158]: INFO nova.compute.manager [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Terminating instance
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Instance destroyed successfully.
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.objects.instance [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'resources' on Instance uuid 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:52:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1366138078',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1366138078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1366138078',id=49,image_ref='8769b436-2f27-4608-8705-b50cd12bcabf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfjagh/th2hLhag66t8L7vYuelc/BHbQTnqm5B+I9xnavF1cAHTvDwJ7vGW8tyYTAgtd92kyrRcX/Lgp9f30ssFQhpmgF2+QIE77cmXGW2r/ehZAwQZ3lfod+jEMJoOBA==',key_name='tempest-keypair-216473515',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:52:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-9z4blqbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1100093910',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d339d632dc04d9996c284a37269ee55',uuid=6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "address": "fa:16:3e:74:30:40", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7ae3f94-e7", "ovs_interfaceid": "d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_vif [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7ae3f94-e7, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:12 user nova-compute[73158]: INFO os_vif [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:30:40,bridge_name='br-int',has_traffic_filtering=True,id=d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7ae3f94-e7')
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOmcvTZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:54:12 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be03fc-54e7-4b62-bfb5-ae54e761466b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c023e2-eb7e-4bdd-ab53-34ff9348443a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:54:12 user nova-compute[73158]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b (non-flash)
Aug 17 10:54:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:54:12 user nova-compute[73158]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b (non-flash)
Aug 17 10:54:12 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c187ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8b6c1-f97d-4c71-89e3-adf87467e6a6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8f60f2-cee2-46b1-a42f-30dd5c4650f8]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-unplugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-unplugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-unplugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG nova.compute.manager [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:54:12 user nova-compute[73158]: WARNING nova.compute.manager [req-11a14980-572a-4407-b473-0539c1b67052 req-9f0f6b8b-9646-4ef2-ba74-651db4665917 service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received unexpected event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with vm_state active and task_state deleting.
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aac59cb-8c75-4bdd-ae15-924bfd346d8c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:54:12 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a61ae2-25ee-449d-8a53-b05c1255faa7]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e653f74-eb90-4b89-9312-5e5d97a597e1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf138741-b216-4de8-b9eb-3e0fd513084f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260]
Aug 17 10:54:13 user nova-compute[73158]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b, portal: 172.16.0.220,3260] successful.
Aug 17 10:54:13 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fcc75-d078-45b5-b6e4-df40aca7999b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eda5c9-f2db-4f2c-916d-fb4d193bef3e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== disconnect_volume: return (257ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:54:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Deleting instance files /opt/stack/data/nova/instances/6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca_del
Aug 17 10:54:13 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Deletion of /opt/stack/data/nova/instances/6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca_del complete
Aug 17 10:54:13 user nova-compute[73158]: INFO nova.compute.manager [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 17 10:54:13 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:54:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:14 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:54:14 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Took 1.34 seconds to deallocate network for instance.
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:54:15 user nova-compute[73158]: WARNING nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received unexpected event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with vm_state active and task_state deleting.
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:54:15 user nova-compute[73158]: WARNING nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received unexpected event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with vm_state active and task_state deleting.
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-unplugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-unplugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-unplugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Acquiring lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] No waiting events found dispatching network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:54:15 user nova-compute[73158]: WARNING nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received unexpected event network-vif-plugged-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 for instance with vm_state active and task_state deleting.
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [req-594990fc-197f-4629-bc22-c1ce0ae1b83d req-834bb74c-dade-4180-ab0f-444cb24b587c service nova] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Received event network-vif-deleted-d7ae3f94-e7c7-4cf2-88c8-3eb4034ab6b1 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:54:15 user nova-compute[73158]: INFO nova.compute.manager [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Took 0.77 seconds to detach 1 volumes for instance.
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Deleting volume: c66fcc75-d078-45b5-b6e4-df40aca7999b {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:15 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Deleted allocations for instance 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca
Aug 17 10:54:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-7a414f9d-ae5c-4839-ba59-83fb4fd05af5 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.670s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:54:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:54:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:27 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269652.8323724, 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:54:27 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] VM Stopped (Lifecycle Event)
Aug 17 10:54:27 user nova-compute[73158]: DEBUG nova.compute.manager [None req-03b2b4f7-84a5-435c-95b8-19b4cca2df2d None None] [instance: 6dbdc0f0-c1b3-4080-a7a9-58e7a738e2ca] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:54:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:54:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:54:56 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 63a3094d-f43d-45cc-8563-8b73122e18a0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [{"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-63a3094d-f43d-45cc-8563-8b73122e18a0" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:54:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:54:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:54:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:55:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:55:05 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:55:05 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:55:05 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=24.152206420898438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 63a3094d-f43d-45cc-8563-8b73122e18a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:55:05 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:55:06 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:55:06 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:55:06 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:55:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:08 user nova-compute[73158]: INFO nova.compute.manager [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Terminating instance
Aug 17 10:55:08 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-25863f71-ff41-41d0-8c0f-dd7240abbdb0 req-69e5274c-4936-4357-83a6-ec2b08c43c19 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-vif-unplugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-25863f71-ff41-41d0-8c0f-dd7240abbdb0 req-69e5274c-4936-4357-83a6-ec2b08c43c19 service nova] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-25863f71-ff41-41d0-8c0f-dd7240abbdb0 req-69e5274c-4936-4357-83a6-ec2b08c43c19 service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-25863f71-ff41-41d0-8c0f-dd7240abbdb0 req-69e5274c-4936-4357-83a6-ec2b08c43c19 service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-25863f71-ff41-41d0-8c0f-dd7240abbdb0 req-69e5274c-4936-4357-83a6-ec2b08c43c19 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] No waiting events found dispatching network-vif-unplugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.compute.manager [req-25863f71-ff41-41d0-8c0f-dd7240abbdb0 req-69e5274c-4936-4357-83a6-ec2b08c43c19 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-vif-unplugged-5927a600-0b16-40f6-9fbc-a0652bede7bd for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Instance destroyed successfully.
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'resources' on Instance uuid 63a3094d-f43d-45cc-8563-8b73122e18a0 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-280708008',display_name='tempest-TestVolumeBootPattern-volume-backed-server-280708008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-280708008',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBIFkrnmcAmU1wBorK1hVMkrUWAu6479sqTC9qjLoBY0WDsZcW0wvjy0qR9oLyTCiZQKpMPWUKLUUx8s2yWH9/IGn6en3N8lW1MGBSIQoLp76cn/ePSlBbfSES6KhYkpw==',key_name='tempest-keypair-1971407893',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:50:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-uy6j0xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d339d632dc04d9996c284a37269ee55',uuid=63a3094d-f43d-45cc-8563-8b73122e18a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "address": "fa:16:3e:e3:d8:c0", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5927a600-0b", "ovs_interfaceid": "5927a600-0b16-40f6-9fbc-a0652bede7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_vif [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5927a600-0b, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:09 user nova-compute[73158]: INFO os_vif [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=5927a600-0b16-40f6-9fbc-a0652bede7bd,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5927a600-0b')
Aug 17 10:55:09 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVZJgMvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:55:09 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f84dd-2575-4188-8c08-5cc01021dfac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b88b90-317d-43d8-8c25-768c794465e9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:55:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 (non-flash)
Aug 17 10:55:09 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc341c53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[644a56eb-d06d-4a1a-bc2e-0beb7997eccd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9d0a7-4988-4a95-becb-46d85fb345ec]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.102s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ae58b-3ee4-4253-b066-ab40387ccd5c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f8b41-0924-41dd-8c3a-f86c085ed287]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf69430ee-3817fde32a47e7ee', '/dev/disk/by-id/scsi-23338313766646533', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f69430ee') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45fc7ae-d722-404c-ba9a-c347a293d1b7]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:55:09 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22219a0-4810-4edc-8e66-d813d0bb292d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[98587e62-49d8-47f7-aac5-2ad7963534a3]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260]
Aug 17 10:55:10 user nova-compute[73158]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73, portal: 172.16.0.220,3260] successful.
Aug 17 10:55:10 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b35d7571-ace1-4085-b605-374120c2ca73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[42087e6b-2195-4428-94f6-df0e2cdcf1d0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== disconnect_volume: return (358ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:55:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Deleting instance files /opt/stack/data/nova/instances/63a3094d-f43d-45cc-8563-8b73122e18a0_del
Aug 17 10:55:10 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Deletion of /opt/stack/data/nova/instances/63a3094d-f43d-45cc-8563-8b73122e18a0_del complete
Aug 17 10:55:10 user nova-compute[73158]: INFO nova.compute.manager [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 17 10:55:10 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:55:10 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Took 0.75 seconds to deallocate network for instance.
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-d4544227-3c24-46ea-80c7-3ec5defdff9c req-4d3b616c-f9da-44a0-a8c1-cb1ac9ad3c08 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-vif-deleted-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:55:10 user nova-compute[73158]: INFO nova.compute.manager [req-d4544227-3c24-46ea-80c7-3ec5defdff9c req-4d3b616c-f9da-44a0-a8c1-cb1ac9ad3c08 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Neutron deleted interface 5927a600-0b16-40f6-9fbc-a0652bede7bd; detaching it from the instance and deleting it from the info cache
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.network.neutron [req-d4544227-3c24-46ea-80c7-3ec5defdff9c req-4d3b616c-f9da-44a0-a8c1-cb1ac9ad3c08 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:55:10 user nova-compute[73158]: DEBUG nova.compute.manager [req-d4544227-3c24-46ea-80c7-3ec5defdff9c req-4d3b616c-f9da-44a0-a8c1-cb1ac9ad3c08 service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Detach interface failed, port_id=5927a600-0b16-40f6-9fbc-a0652bede7bd, reason: Instance 63a3094d-f43d-45cc-8563-8b73122e18a0 could not be found. {{(pid=73158) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7c7cb0a-bfec-447b-b4b6-d57fa9f017d1 req-7b814491-247a-4b41-b3c9-44c4d980c8af service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received event network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7c7cb0a-bfec-447b-b4b6-d57fa9f017d1 req-7b814491-247a-4b41-b3c9-44c4d980c8af service nova] Acquiring lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7c7cb0a-bfec-447b-b4b6-d57fa9f017d1 req-7b814491-247a-4b41-b3c9-44c4d980c8af service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f7c7cb0a-bfec-447b-b4b6-d57fa9f017d1 req-7b814491-247a-4b41-b3c9-44c4d980c8af service nova] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG nova.compute.manager [req-f7c7cb0a-bfec-447b-b4b6-d57fa9f017d1 req-7b814491-247a-4b41-b3c9-44c4d980c8af service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] No waiting events found dispatching network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:55:11 user nova-compute[73158]: WARNING nova.compute.manager [req-f7c7cb0a-bfec-447b-b4b6-d57fa9f017d1 req-7b814491-247a-4b41-b3c9-44c4d980c8af service nova] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Received unexpected event network-vif-plugged-5927a600-0b16-40f6-9fbc-a0652bede7bd for instance with vm_state active and task_state deleting.
Aug 17 10:55:11 user nova-compute[73158]: INFO nova.compute.manager [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 10:55:11 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Deleting volume: b35d7571-ace1-4085-b605-374120c2ca73 {{(pid=73158) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:55:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:11 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Deleted allocations for instance 63a3094d-f43d-45cc-8563-8b73122e18a0
Aug 17 10:55:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4057d580-0658-4b9f-b2d2-a459982c1a0c tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "63a3094d-f43d-45cc-8563-8b73122e18a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:55:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269709.6877935, 63a3094d-f43d-45cc-8563-8b73122e18a0 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:55:24 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] VM Stopped (Lifecycle Event)
Aug 17 10:55:24 user nova-compute[73158]: DEBUG nova.compute.manager [None req-459a1eea-a572-4697-ad97-3502e9f92169 None None] [instance: 63a3094d-f43d-45cc-8563-8b73122e18a0] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:55:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:55:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:00 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:56:06 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:56:06 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=24.150890350341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:56:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "f526b222-2ce1-432e-b883-66d053a15dab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:56:12 user nova-compute[73158]: INFO nova.compute.claims [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Claim successful on node user
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:56:12 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:56:12 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:56:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:56:13 user nova-compute[73158]: INFO nova.virt.block_device [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Booting with volume 28d93d8c-d592-4d49-8f7b-25cb7f636600 at /dev/vda
Aug 17 10:56:13 user nova-compute[73158]: DEBUG nova.policy [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d339d632dc04d9996c284a37269ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b44dd2b2840f19d651e921cb73ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG os_brick.utils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622b752-0c54-420f-8f0a-ed8073aa5885]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3bbbfc-985a-4661-ae7a-42fc581a21ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867333b-c536-4599-86c0-288dc49d6d96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[94384ee3-8282-460c-a832-ad72b6beef2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:56:13 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:56:13 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8525d9-817f-40d5-81ed-221d0fdc63cb]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG os_brick.utils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating existing volume attachment record: 2cc30ecd-35d8-49f8-b904-4231a356cc6b {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:56:13 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Successfully created port: 5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Successfully updated port: 5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquired lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-changed-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG nova.compute.manager [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Refreshing instance network info cache due to event network-changed-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:56:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] Acquiring lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG nova.network.neutron [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating instance_info_cache with network_info: [{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Releasing lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Instance network_info: |[{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] Acquired lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Refreshing network info cache for port 5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updated VIF entry in instance network info cache for port 5fdfaf4c-ed21-49c4-b36e-c4cf5351359d. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG nova.network.neutron [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating instance_info_cache with network_info: [{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:56:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1575a44a-4b92-4e4b-9c66-6f9e89d2a63c req-f113e41d-add1-4464-ad43-8a3f33f59984 service nova] Releasing lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:56:16 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:56:23 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Creating image(s)
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Ensure instance console log exists: /opt/stack/data/nova/instances/f526b222-2ce1-432e-b883-66d053a15dab/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Start _get_guest_xml network_info=[{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '2cc30ecd-35d8-49f8-b904-4231a356cc6b', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f526b222-2ce1-432e-b883-66d053a15dab', 'attached_at': '', 'detached_at': '', 'volume_id': '28d93d8c-d592-4d49-8f7b-25cb7f636600', 'serial': '28d93d8c-d592-4d49-8f7b-25cb7f636600'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:56:23 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:56:23 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:56:23 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:56:23 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:56:23 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a4ab2-ec2d-43a6-a8f5-22deee4df8a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:56:23 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[836830a6-2087-46c8-8ca2-afe3b649521b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600] added
Aug 17 10:56:23 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f63956a-849c-4bd6-aedb-07a2a24e5b4c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c44f6-a038-49af-bfdb-14743a18f6c2]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGwhsmUp {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGwhsmUp" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d8b6f-ecb4-4cce-8b3e-cfdac0ca393c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KGwhsmUp'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db325646-10df-4435-ad6f-3e74c8d0247d]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[711114a1-c17e-4b19-b3e4-3620b34b750f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:56:23 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:56:23 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:56:23 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:56:23 user nova-compute[73158]: 
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4615eb08-7a42-4233-812b-4e9d2be02d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]
Aug 17 10:56:23 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.
Aug 17 10:56:23 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97aa279-2db0-49ff-a342-7bda678765b8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cea74ad-849e-40d1-af6d-7a0f600aee73]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 10:56:23 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 10:56:23 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05f5c4a-abd9-42d2-b6f3-0a9e777b73b7]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:56:23 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23338656430636664', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338656430636664', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1821761115',display_name='tempest-TestVolumeBootPattern-server-1821761115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1821761115',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-xefltvo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:56:13Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=f526b222-2ce1-432e-b883-66d053a15dab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.objects.instance [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'pci_devices' on Instance uuid f526b222-2ce1-432e-b883-66d053a15dab {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:56:24 user nova-compute[73158]:   <uuid>f526b222-2ce1-432e-b883-66d053a15dab</uuid>
Aug 17 10:56:24 user nova-compute[73158]:   <name>instance-00000032</name>
Aug 17 10:56:24 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:56:24 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:56:24 user nova-compute[73158]:   <metadata>
Aug 17 10:56:24 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:56:24 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:56:24 user nova-compute[73158]:       <nova:name>tempest-TestVolumeBootPattern-server-1821761115</nova:name>
Aug 17 10:56:24 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:56:23</nova:creationTime>
Aug 17 10:56:24 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:56:24 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:56:24 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:56:24 user nova-compute[73158]:       <nova:owner>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:user uuid="9d339d632dc04d9996c284a37269ee55">tempest-TestVolumeBootPattern-1100093910-project-member</nova:user>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:project uuid="356b44dd2b2840f19d651e921cb73ba7">tempest-TestVolumeBootPattern-1100093910</nova:project>
Aug 17 10:56:24 user nova-compute[73158]:       </nova:owner>
Aug 17 10:56:24 user nova-compute[73158]:       <nova:ports>
Aug 17 10:56:24 user nova-compute[73158]:         <nova:port uuid="5fdfaf4c-ed21-49c4-b36e-c4cf5351359d">
Aug 17 10:56:24 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 10:56:24 user nova-compute[73158]:         </nova:port>
Aug 17 10:56:24 user nova-compute[73158]:       </nova:ports>
Aug 17 10:56:24 user nova-compute[73158]:     </nova:instance>
Aug 17 10:56:24 user nova-compute[73158]:   </metadata>
Aug 17 10:56:24 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:56:24 user nova-compute[73158]:     <system>
Aug 17 10:56:24 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:56:24 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:56:24 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:56:24 user nova-compute[73158]:       <entry name="serial">f526b222-2ce1-432e-b883-66d053a15dab</entry>
Aug 17 10:56:24 user nova-compute[73158]:       <entry name="uuid">f526b222-2ce1-432e-b883-66d053a15dab</entry>
Aug 17 10:56:24 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:56:24 user nova-compute[73158]:     </system>
Aug 17 10:56:24 user nova-compute[73158]:   </sysinfo>
Aug 17 10:56:24 user nova-compute[73158]:   <os>
Aug 17 10:56:24 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:56:24 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:56:24 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:56:24 user nova-compute[73158]:   </os>
Aug 17 10:56:24 user nova-compute[73158]:   <features>
Aug 17 10:56:24 user nova-compute[73158]:     <acpi/>
Aug 17 10:56:24 user nova-compute[73158]:     <apic/>
Aug 17 10:56:24 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:56:24 user nova-compute[73158]:   </features>
Aug 17 10:56:24 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:56:24 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:56:24 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:56:24 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:56:24 user nova-compute[73158]:   </clock>
Aug 17 10:56:24 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:56:24 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:56:24 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:56:24 user nova-compute[73158]:   </cpu>
Aug 17 10:56:24 user nova-compute[73158]:   <devices>
Aug 17 10:56:24 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:56:24 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:56:24 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:56:24 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:56:24 user nova-compute[73158]:       <serial>28d93d8c-d592-4d49-8f7b-25cb7f636600</serial>
Aug 17 10:56:24 user nova-compute[73158]:     </disk>
Aug 17 10:56:24 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:56:24 user nova-compute[73158]:       <mac address="fa:16:3e:ba:63:89"/>
Aug 17 10:56:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:56:24 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:56:24 user nova-compute[73158]:       <target dev="tap5fdfaf4c-ed"/>
Aug 17 10:56:24 user nova-compute[73158]:     </interface>
Aug 17 10:56:24 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:56:24 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/f526b222-2ce1-432e-b883-66d053a15dab/console.log" append="off"/>
Aug 17 10:56:24 user nova-compute[73158]:     </serial>
Aug 17 10:56:24 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:56:24 user nova-compute[73158]:     <video>
Aug 17 10:56:24 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:56:24 user nova-compute[73158]:     </video>
Aug 17 10:56:24 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:56:24 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:56:24 user nova-compute[73158]:     </rng>
Aug 17 10:56:24 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:56:24 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:56:24 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:56:24 user nova-compute[73158]:     </memballoon>
Aug 17 10:56:24 user nova-compute[73158]:   </devices>
Aug 17 10:56:24 user nova-compute[73158]: </domain>
Aug 17 10:56:24 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1821761115',display_name='tempest-TestVolumeBootPattern-server-1821761115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1821761115',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-xefltvo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:56:13Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=f526b222-2ce1-432e-b883-66d053a15dab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG os_vif [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fdfaf4c-ed, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fdfaf4c-ed, col_values=(('external_ids', {'iface-id': '5fdfaf4c-ed21-49c4-b36e-c4cf5351359d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:63:89', 'vm-uuid': 'f526b222-2ce1-432e-b883-66d053a15dab'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:24 user nova-compute[73158]: INFO os_vif [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed')
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:56:24 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No VIF found with MAC fa:16:3e:ba:63:89, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-392ab3e5-2f7f-4882-9dc8-ba1bf29bc45e req-582b78b6-b877-4db6-8ca7-5b15c4c76fb0 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-392ab3e5-2f7f-4882-9dc8-ba1bf29bc45e req-582b78b6-b877-4db6-8ca7-5b15c4c76fb0 service nova] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-392ab3e5-2f7f-4882-9dc8-ba1bf29bc45e req-582b78b6-b877-4db6-8ca7-5b15c4c76fb0 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-392ab3e5-2f7f-4882-9dc8-ba1bf29bc45e req-582b78b6-b877-4db6-8ca7-5b15c4c76fb0 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG nova.compute.manager [req-392ab3e5-2f7f-4882-9dc8-ba1bf29bc45e req-582b78b6-b877-4db6-8ca7-5b15c4c76fb0 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] No waiting events found dispatching network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:56:26 user nova-compute[73158]: WARNING nova.compute.manager [req-392ab3e5-2f7f-4882-9dc8-ba1bf29bc45e req-582b78b6-b877-4db6-8ca7-5b15c4c76fb0 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received unexpected event network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d for instance with vm_state building and task_state spawning.
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-cdbbdd2f-8c2c-4654-a787-dff57e76c3ed req-bb3fa2de-4fdc-4508-a70e-28106d55e9e6 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cdbbdd2f-8c2c-4654-a787-dff57e76c3ed req-bb3fa2de-4fdc-4508-a70e-28106d55e9e6 service nova] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cdbbdd2f-8c2c-4654-a787-dff57e76c3ed req-bb3fa2de-4fdc-4508-a70e-28106d55e9e6 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cdbbdd2f-8c2c-4654-a787-dff57e76c3ed req-bb3fa2de-4fdc-4508-a70e-28106d55e9e6 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [req-cdbbdd2f-8c2c-4654-a787-dff57e76c3ed req-bb3fa2de-4fdc-4508-a70e-28106d55e9e6 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] No waiting events found dispatching network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:56:28 user nova-compute[73158]: WARNING nova.compute.manager [req-cdbbdd2f-8c2c-4654-a787-dff57e76c3ed req-bb3fa2de-4fdc-4508-a70e-28106d55e9e6 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received unexpected event network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d for instance with vm_state building and task_state spawning.
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269788.4186237, f526b222-2ce1-432e-b883-66d053a15dab => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] VM Resumed (Lifecycle Event)
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Instance spawned successfully.
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269788.4198632, f526b222-2ce1-432e-b883-66d053a15dab => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] VM Started (Lifecycle Event)
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 17 10:56:28 user nova-compute[73158]: DEBUG nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:56:28 user nova-compute[73158]: INFO nova.compute.manager [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Took 15.90 seconds to build instance.
Aug 17 10:56:28 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-cc8fe0e3-9af0-45ff-88c4-c7a39f33040a tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "f526b222-2ce1-432e-b883-66d053a15dab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.994s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:56:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:53 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid f526b222-2ce1-432e-b883-66d053a15dab {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating instance_info_cache with network_info: [{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:56:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:56:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 10:57:08 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:57:08 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:57:08 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=24.14914321899414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:57:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance f526b222-2ce1-432e-b883-66d053a15dab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:57:09 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:57:14 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:19 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:24 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:57:29 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:34 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:57:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:57:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:57:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:57:39 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:44 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:49 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:57:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:57:59 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 10:58:00 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid f526b222-2ce1-432e-b883-66d053a15dab {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:58:01 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating instance_info_cache with network_info: [{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:58:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:58:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 10:58:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:03 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-changed-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:58:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Refreshing instance network info cache due to event network-changed-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:58:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] Acquiring lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:58:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] Acquired lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:58:04 user nova-compute[73158]: DEBUG nova.network.neutron [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Refreshing network info cache for port 5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:58:04 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "f526b222-2ce1-432e-b883-66d053a15dab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:05 user nova-compute[73158]: INFO nova.compute.manager [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Terminating instance
Aug 17 10:58:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updated VIF entry in instance network info cache for port 5fdfaf4c-ed21-49c4-b36e-c4cf5351359d. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG nova.network.neutron [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating instance_info_cache with network_info: [{"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-93d8bf78-4592-4f37-82c0-937c8f3e2533 req-6d9a6bed-4e39-4a3e-ad54-b8d5f5c0c2d1 service nova] Releasing lock "refresh_cache-f526b222-2ce1-432e-b883-66d053a15dab" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Instance destroyed successfully.
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.objects.instance [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'resources' on Instance uuid f526b222-2ce1-432e-b883-66d053a15dab {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1821761115',display_name='tempest-TestVolumeBootPattern-server-1821761115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1821761115',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:56:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-xefltvo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:56:29Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=f526b222-2ce1-432e-b883-66d053a15dab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "address": "fa:16:3e:ba:63:89", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdfaf4c-ed", "ovs_interfaceid": "5fdfaf4c-ed21-49c4-b36e-c4cf5351359d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_vif [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fdfaf4c-ed, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:06 user nova-compute[73158]: INFO os_vif [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:63:89,bridge_name='br-int',has_traffic_filtering=True,id=5fdfaf4c-ed21-49c4-b36e-c4cf5351359d,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdfaf4c-ed')
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:58:06 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87aa1a-5b54-4a38-a4dc-5019480f29ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aedc670-d85e-48db-98cb-abb47b5f2985]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 10:58:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 10:58:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcc1c162200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6ade1-60d7-4876-a133-5390d1f3ee06]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b755a3-6f71-459a-b45e-0b6ff881294f]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e661ce-dccb-409c-878b-09645531dcaa]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5bf5ea-aa04-42fc-8b01-81afe3a36365]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6f41af80', '/dev/disk/by-id/scsi-23338656430636664', '/dev/disk/by-id/scsi-1SCST_BIO6f41af80-38ed0cfdd2b88b93') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f867ae04-8503-4a91-811e-ab77d60c92e5]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[03adad8d-56e1-49ae-b848-abebd2afe969]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3cd31a-0590-4aa6-b20f-c2fb14013cda]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]
Aug 17 10:58:06 user nova-compute[73158]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.
Aug 17 10:58:06 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad049c17-e554-429b-b219-9c843c7c8240]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== disconnect_volume: return (274ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 10:58:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Deleting instance files /opt/stack/data/nova/instances/f526b222-2ce1-432e-b883-66d053a15dab_del
Aug 17 10:58:06 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Deletion of /opt/stack/data/nova/instances/f526b222-2ce1-432e-b883-66d053a15dab_del complete
Aug 17 10:58:06 user nova-compute[73158]: INFO nova.compute.manager [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-vif-unplugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] No waiting events found dispatching network-vif-unplugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-vif-unplugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] Acquiring lock "f526b222-2ce1-432e-b883-66d053a15dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] Lock "f526b222-2ce1-432e-b883-66d053a15dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:06 user nova-compute[73158]: DEBUG nova.compute.manager [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] No waiting events found dispatching network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:58:06 user nova-compute[73158]: WARNING nova.compute.manager [req-3a161b45-2af1-4321-9ba3-f2528c68ea13 req-867f455b-9f45-4048-9db0-5b6fc4aa9584 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received unexpected event network-vif-plugged-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d for instance with vm_state active and task_state deleting.
Aug 17 10:58:07 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:58:07 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Took 0.71 seconds to deallocate network for instance.
Aug 17 10:58:07 user nova-compute[73158]: DEBUG nova.compute.manager [req-2dcaf26b-e676-4f10-a027-3131e49e9189 req-da47edd5-bdb0-42bc-b551-581a6e057803 service nova] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Received event network-vif-deleted-5fdfaf4c-ed21-49c4-b36e-c4cf5351359d {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:58:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:08 user nova-compute[73158]: INFO nova.compute.manager [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Took 0.81 seconds to detach 1 volumes for instance.
Aug 17 10:58:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:58:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:08 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Deleted allocations for instance f526b222-2ce1-432e-b883-66d053a15dab
Aug 17 10:58:08 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-8069f506-80b6-44c3-aaae-9d0ee7b8d717 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "f526b222-2ce1-432e-b883-66d053a15dab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.163s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:58:09 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:58:09 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=24.14828872680664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:58:09 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 10:58:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:17 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:21 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692269886.11505, f526b222-2ce1-432e-b883-66d053a15dab => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:58:21 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: f526b222-2ce1-432e-b883-66d053a15dab] VM Stopped (Lifecycle Event)
Aug 17 10:58:21 user nova-compute[73158]: DEBUG nova.compute.manager [None req-bf2fc3fc-f9b6-4bbf-bfd7-d721a660812b None None] [instance: f526b222-2ce1-432e-b883-66d053a15dab] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:58:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:21 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 10:58:23 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 10:58:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:58:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:58:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:58:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:58:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:54 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 10:58:57 user nova-compute[73158]: INFO nova.compute.claims [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Claim successful on node user
Aug 17 10:58:57 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.175s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:58:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG nova.network.neutron [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 10:58:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 10:58:58 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 10:58:58 user nova-compute[73158]: INFO nova.virt.block_device [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Booting with volume 28d93d8c-d592-4d49-8f7b-25cb7f636600 at /dev/vda
Aug 17 10:58:58 user nova-compute[73158]: DEBUG nova.policy [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d339d632dc04d9996c284a37269ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b44dd2b2840f19d651e921cb73ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG os_brick.utils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab9dff1-52b2-4b10-adcf-828c011538cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d625ee-64b9-49a4-9101-40f1611efbe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f9703-edd3-401b-8722-34c66ae6d320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[086986fd-3136-46e1-beef-5daa5275a846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 10:58:58 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 10:58:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[760355c1-bee8-46ba-94f5-ace986a361ee]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG os_brick.utils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:58:58 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating existing volume attachment record: d6482c54-5941-4ebb-b5eb-349ba49c3300 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Successfully created port: 5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Successfully updated port: 5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-changed-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Refreshing instance network info cache due to event network-changed-5aaa7a5e-7912-4bd0-9fdb-649c83a22878. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 10:58:59 user nova-compute[73158]: DEBUG nova.network.neutron [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG nova.network.neutron [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Instance network_info: |[{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Refreshing network info cache for port 5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updated VIF entry in instance network info cache for port 5aaa7a5e-7912-4bd0-9fdb-649c83a22878. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG nova.network.neutron [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 10:59:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-1cdae5f1-fb9c-40ce-8db2-fe41a704162f req-1578cce2-c5a0-4189-83b2-c430f81c5e54 service nova] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 10:59:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 10:59:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 10:59:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Skipping network cache update for instance because it is Building. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 10:59:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 10:59:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 10:59:11 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:59:11 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=24.14742660522461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 1527b230-f5eb-40c5-8fe6-09ba14499744 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 10:59:11 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 10:59:12 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 10:59:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 10:59:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Creating image(s)
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Ensure instance console log exists: /opt/stack/data/nova/instances/1527b230-f5eb-40c5-8fe6-09ba14499744/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Start _get_guest_xml network_info=[{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': 'd6482c54-5941-4ebb-b5eb-349ba49c3300', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1527b230-f5eb-40c5-8fe6-09ba14499744', 'attached_at': '', 'detached_at': '', 'volume_id': '28d93d8c-d592-4d49-8f7b-25cb7f636600', 'serial': '28d93d8c-d592-4d49-8f7b-25cb7f636600'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 10:59:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:59:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 10:59:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:59:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 10:59:14 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ebc25c-febc-49b2-b677-1feb729bdaaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 10:59:14 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[605b0284-f267-45fa-ace3-2a288c87467d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600] added
Aug 17 10:59:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b270313-e4b1-413f-8f24-967e93d7f2c5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3524413-bca7-4a06-8a7e-425cccf57159]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGwhsmUp {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGwhsmUp" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bfc501-533b-4771-b41f-20badd3ca5a1]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KGwhsmUp'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e96f03-653a-4d5c-81ab-86d91816fb96]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb890f-6521-42b7-9890-47f34fe54625]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:59:15 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 10:59:15 user nova-compute[73158]:  {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:59:15 user nova-compute[73158]: WARNING os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 10:59:15 user nova-compute[73158]: 
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d21b46-cdcc-481e-b3fb-4255b6854b53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]
Aug 17 10:59:15 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.
Aug 17 10:59:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a4f237-ab0a-4108-8ead-2ea331e0e24a]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ccdf80-f642-49c6-a4ee-a5fea86388c0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 10:59:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 10:59:15 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b398c348-e1cf-4dd4-b536-810c385aa9ff]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:15 user nova-compute[73158]: WARNING nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Aug 17 10:59:15 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Triggering sync for uuid 1527b230-f5eb-40c5-8fe6-09ba14499744 {{(pid=73158) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 10:59:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23338656430636664', 'path': '/dev/sdb'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338656430636664', 'path': '/dev/sdb'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1454175146',display_name='tempest-TestVolumeBootPattern-server-1454175146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1454175146',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-0r7npzih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:58:58Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=1527b230-f5eb-40c5-8fe6-09ba14499744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.objects.instance [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'pci_devices' on Instance uuid 1527b230-f5eb-40c5-8fe6-09ba14499744 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] End _get_guest_xml xml=<domain type="kvm">
Aug 17 10:59:16 user nova-compute[73158]:   <uuid>1527b230-f5eb-40c5-8fe6-09ba14499744</uuid>
Aug 17 10:59:16 user nova-compute[73158]:   <name>instance-00000033</name>
Aug 17 10:59:16 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 10:59:16 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 10:59:16 user nova-compute[73158]:   <metadata>
Aug 17 10:59:16 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 10:59:16 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 10:59:16 user nova-compute[73158]:       <nova:name>tempest-TestVolumeBootPattern-server-1454175146</nova:name>
Aug 17 10:59:16 user nova-compute[73158]:       <nova:creationTime>2023-08-17 10:59:14</nova:creationTime>
Aug 17 10:59:16 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 10:59:16 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 10:59:16 user nova-compute[73158]:       </nova:flavor>
Aug 17 10:59:16 user nova-compute[73158]:       <nova:owner>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:user uuid="9d339d632dc04d9996c284a37269ee55">tempest-TestVolumeBootPattern-1100093910-project-member</nova:user>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:project uuid="356b44dd2b2840f19d651e921cb73ba7">tempest-TestVolumeBootPattern-1100093910</nova:project>
Aug 17 10:59:16 user nova-compute[73158]:       </nova:owner>
Aug 17 10:59:16 user nova-compute[73158]:       <nova:ports>
Aug 17 10:59:16 user nova-compute[73158]:         <nova:port uuid="5aaa7a5e-7912-4bd0-9fdb-649c83a22878">
Aug 17 10:59:16 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 10:59:16 user nova-compute[73158]:         </nova:port>
Aug 17 10:59:16 user nova-compute[73158]:       </nova:ports>
Aug 17 10:59:16 user nova-compute[73158]:     </nova:instance>
Aug 17 10:59:16 user nova-compute[73158]:   </metadata>
Aug 17 10:59:16 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 10:59:16 user nova-compute[73158]:     <system>
Aug 17 10:59:16 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 10:59:16 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 10:59:16 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 10:59:16 user nova-compute[73158]:       <entry name="serial">1527b230-f5eb-40c5-8fe6-09ba14499744</entry>
Aug 17 10:59:16 user nova-compute[73158]:       <entry name="uuid">1527b230-f5eb-40c5-8fe6-09ba14499744</entry>
Aug 17 10:59:16 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 10:59:16 user nova-compute[73158]:     </system>
Aug 17 10:59:16 user nova-compute[73158]:   </sysinfo>
Aug 17 10:59:16 user nova-compute[73158]:   <os>
Aug 17 10:59:16 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 10:59:16 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 10:59:16 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 10:59:16 user nova-compute[73158]:   </os>
Aug 17 10:59:16 user nova-compute[73158]:   <features>
Aug 17 10:59:16 user nova-compute[73158]:     <acpi/>
Aug 17 10:59:16 user nova-compute[73158]:     <apic/>
Aug 17 10:59:16 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 10:59:16 user nova-compute[73158]:   </features>
Aug 17 10:59:16 user nova-compute[73158]:   <clock offset="utc">
Aug 17 10:59:16 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 10:59:16 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 10:59:16 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 10:59:16 user nova-compute[73158]:   </clock>
Aug 17 10:59:16 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 10:59:16 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 10:59:16 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 10:59:16 user nova-compute[73158]:   </cpu>
Aug 17 10:59:16 user nova-compute[73158]:   <devices>
Aug 17 10:59:16 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 10:59:16 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 10:59:16 user nova-compute[73158]:       <source dev="/dev/sdb"/>
Aug 17 10:59:16 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 10:59:16 user nova-compute[73158]:       <serial>28d93d8c-d592-4d49-8f7b-25cb7f636600</serial>
Aug 17 10:59:16 user nova-compute[73158]:     </disk>
Aug 17 10:59:16 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 10:59:16 user nova-compute[73158]:       <mac address="fa:16:3e:1c:d3:41"/>
Aug 17 10:59:16 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:59:16 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 10:59:16 user nova-compute[73158]:       <target dev="tap5aaa7a5e-79"/>
Aug 17 10:59:16 user nova-compute[73158]:     </interface>
Aug 17 10:59:16 user nova-compute[73158]:     <serial type="pty">
Aug 17 10:59:16 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/1527b230-f5eb-40c5-8fe6-09ba14499744/console.log" append="off"/>
Aug 17 10:59:16 user nova-compute[73158]:     </serial>
Aug 17 10:59:16 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 10:59:16 user nova-compute[73158]:     <video>
Aug 17 10:59:16 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 10:59:16 user nova-compute[73158]:     </video>
Aug 17 10:59:16 user nova-compute[73158]:     <rng model="virtio">
Aug 17 10:59:16 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 10:59:16 user nova-compute[73158]:     </rng>
Aug 17 10:59:16 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 10:59:16 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 10:59:16 user nova-compute[73158]:       <stats period="10"/>
Aug 17 10:59:16 user nova-compute[73158]:     </memballoon>
Aug 17 10:59:16 user nova-compute[73158]:   </devices>
Aug 17 10:59:16 user nova-compute[73158]: </domain>
Aug 17 10:59:16 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1454175146',display_name='tempest-TestVolumeBootPattern-server-1454175146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1454175146',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-0r7npzih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T10:58:58Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=1527b230-f5eb-40c5-8fe6-09ba14499744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG os_vif [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5aaa7a5e-79, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5aaa7a5e-79, col_values=(('external_ids', {'iface-id': '5aaa7a5e-7912-4bd0-9fdb-649c83a22878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:d3:41', 'vm-uuid': '1527b230-f5eb-40c5-8fe6-09ba14499744'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:16 user nova-compute[73158]: INFO os_vif [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79')
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 10:59:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No VIF found with MAC fa:16:3e:1c:d3:41, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-199e75e5-0f79-454b-9644-74ae0abb2d8a req-3710a809-1258-42d0-b39d-5ac412195e9f service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-199e75e5-0f79-454b-9644-74ae0abb2d8a req-3710a809-1258-42d0-b39d-5ac412195e9f service nova] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-199e75e5-0f79-454b-9644-74ae0abb2d8a req-3710a809-1258-42d0-b39d-5ac412195e9f service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-199e75e5-0f79-454b-9644-74ae0abb2d8a req-3710a809-1258-42d0-b39d-5ac412195e9f service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-199e75e5-0f79-454b-9644-74ae0abb2d8a req-3710a809-1258-42d0-b39d-5ac412195e9f service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] No waiting events found dispatching network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:59:17 user nova-compute[73158]: WARNING nova.compute.manager [req-199e75e5-0f79-454b-9644-74ae0abb2d8a req-3710a809-1258-42d0-b39d-5ac412195e9f service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received unexpected event network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 for instance with vm_state building and task_state spawning.
Aug 17 10:59:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269959.8113718, 1527b230-f5eb-40c5-8fe6-09ba14499744 => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:59:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] VM Resumed (Lifecycle Event)
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 10:59:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Instance spawned successfully.
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 10:59:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692269959.8152785, 1527b230-f5eb-40c5-8fe6-09ba14499744 => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 10:59:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] VM Started (Lifecycle Event)
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-de4945c8-0d63-4139-95ad-d4df6d41d9de req-e9a621b0-e5b2-427d-ad46-d78b41e0416a service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-de4945c8-0d63-4139-95ad-d4df6d41d9de req-e9a621b0-e5b2-427d-ad46-d78b41e0416a service nova] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-de4945c8-0d63-4139-95ad-d4df6d41d9de req-e9a621b0-e5b2-427d-ad46-d78b41e0416a service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-de4945c8-0d63-4139-95ad-d4df6d41d9de req-e9a621b0-e5b2-427d-ad46-d78b41e0416a service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-de4945c8-0d63-4139-95ad-d4df6d41d9de req-e9a621b0-e5b2-427d-ad46-d78b41e0416a service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] No waiting events found dispatching network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 10:59:19 user nova-compute[73158]: WARNING nova.compute.manager [req-de4945c8-0d63-4139-95ad-d4df6d41d9de req-e9a621b0-e5b2-427d-ad46-d78b41e0416a service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received unexpected event network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 for instance with vm_state building and task_state spawning.
Aug 17 10:59:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:59:19 user nova-compute[73158]: INFO nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 17 10:59:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 10:59:20 user nova-compute[73158]: INFO nova.compute.manager [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Took 22.31 seconds to build instance.
Aug 17 10:59:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-220c6b56-cb14-4a60-aefd-e86cf905de56 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.404s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.443s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 10:59:20 user nova-compute[73158]: INFO nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 10:59:20 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 10:59:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:59:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:59:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:59:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 10:59:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 10:59:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 10:59:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 10:59:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:59:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 10:59:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:00 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 1527b230-f5eb-40c5-8fe6-09ba14499744 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:00:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:00:05 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:12 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:00:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:00:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:00:12 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:00:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:00:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:00:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=24.146045684814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 1527b230-f5eb-40c5-8fe6-09ba14499744 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:00:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:00:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:23 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:00:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:00:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:00:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-changed-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:00:49 user nova-compute[73158]: DEBUG nova.compute.manager [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Refreshing instance network info cache due to event network-changed-5aaa7a5e-7912-4bd0-9fdb-649c83a22878. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:00:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:00:49 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:00:49 user nova-compute[73158]: DEBUG nova.network.neutron [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Refreshing network info cache for port 5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:00:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updated VIF entry in instance network info cache for port 5aaa7a5e-7912-4bd0-9fdb-649c83a22878. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:00:50 user nova-compute[73158]: DEBUG nova.network.neutron [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:00:50 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-43218ace-7be3-410d-93eb-de5bfe9c588e req-84a6bd8d-6ab5-42b9-85ef-bc827d5d2e62 service nova] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:00:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:55 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:00:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:00:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:01 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "91017363-db79-4d0a-9595-6975be41107d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Starting instance... {{(pid=73158) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73158) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:01:03 user nova-compute[73158]: INFO nova.compute.claims [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Claim successful on node user
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Start building networks asynchronously for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Allocating IP information in the background. {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] allocate_for_instance() {{(pid=73158) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:01:03 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Start building block device mappings for instance. {{(pid=73158) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:01:03 user nova-compute[73158]: DEBUG nova.policy [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d339d632dc04d9996c284a37269ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b44dd2b2840f19d651e921cb73ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73158) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:01:03 user nova-compute[73158]: INFO nova.virt.block_device [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Booting with volume 4b715de5-4f3b-45eb-a775-6a7760e59be9 at /dev/vda
Aug 17 11:01:04 user nova-compute[73158]: DEBUG os_brick.utils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c1a958-a550-4d6b-bb88-742d8d0dc368]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a470ac56d1f2\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcb1567-6af4-48e1-892f-e6696046a71c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc5ffeb-3764-4485-bd97-7e4c92a448b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f3947-c500-48ea-adb8-026918d48f29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Running cmd (subprocess): nvme version {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] 'nvme version' failed. Not Retrying. {{(pid=73158) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] nvme not present on system {{(pid=73158) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:01:04 user nova-compute[73158]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0844c7a4-8bea-4d71-bd80-6ae845307b31]: (4, '') {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73158) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.lightos [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] LIGHTOS: no hostnqn found. {{(pid=73158) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG os_brick.utils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a470ac56d1f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.virt.block_device [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updating existing volume attachment record: 5b4312af-a9e9-4c33-b416-c454dd186476 {{(pid=73158) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] Skipping network cache update for instance because it is Building. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 1527b230-f5eb-40c5-8fe6-09ba14499744 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:01:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Successfully created port: 138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Successfully updated port: 138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquired lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Building network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-changed-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Refreshing instance network info cache due to event network-changed-138b9fec-885f-444d-995d-bc4872edf49b. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] Acquiring lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:01:05 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Instance cache missing network info. {{(pid=73158) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG nova.network.neutron [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updating instance_info_cache with network_info: [{"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Releasing lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Instance network_info: |[{"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73158) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] Acquired lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Refreshing network info cache for port 138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updated VIF entry in instance network info cache for port 138b9fec-885f-444d-995d-bc4872edf49b. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG nova.network.neutron [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updating instance_info_cache with network_info: [{"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:01:06 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a14b2d0-8ced-40e6-95c3-2ceaf7e50caa req-8b5e07a3-0e59-4e8e-8dc6-c4810e6cd41d service nova] Releasing lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:01:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:01:12 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:01:12 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:01:12 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=24.137100219726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:12 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 1527b230-f5eb-40c5-8fe6-09ba14499744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 91017363-db79-4d0a-9595-6975be41107d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:01:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Start spawning the instance on the hypervisor. {{(pid=73158) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Creating instance directory {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:01:14 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Creating image(s)
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Did not create local disks {{(pid=73158) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Ensure instance console log exists: /opt/stack/data/nova/instances/91017363-db79-4d0a-9595-6975be41107d/console.log {{(pid=73158) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Start _get_guest_xml network_info=[{"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'attachment_id': '5b4312af-a9e9-4c33-b416-c454dd186476', 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdqhKcmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '91017363-db79-4d0a-9595-6975be41107d', 'attached_at': '', 'detached_at': '', 'volume_id': '4b715de5-4f3b-45eb-a775-6a7760e59be9', 'serial': '4b715de5-4f3b-45eb-a775-6a7760e59be9'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:01:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:01:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller missing on host. {{(pid=73158) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.host [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU controller found on host. {{(pid=73158) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73158) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T10:07:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image limits 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flavor pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Image pref 0:0:0 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Got 1 possible topologies {{(pid=73158) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.hardware [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73158) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Calling os-brick to attach iSCSI Volume {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdqhKcmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:01:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:01:14 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:01:14 user nova-compute[73158]: INFO os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4e89c-e889-4c28-bed2-052ac105ff5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:01:14 user nova-compute[73158]:  {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a0827-59b6-444e-bb51-2062acaae274]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9] added\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9] added
Aug 17 11:01:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d55b1ee-ede3-4d64-a5d5-996de788db64]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fc6cae-a3ef-41e2-ab6e-79254946d2ea]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdqhKcmJ {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdqhKcmJ" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b8572-c52c-4534-bb6f-70b8f32eb091]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdqhKcmJ'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be57176-a14f-4f1a-92ef-9d4c6035b5f0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1a5a6-91ae-4cd4-8867-2bd3b5edcd88]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:01:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:01:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --login {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe2a64-1d8e-4627-be64-545b3a1fa447]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260]
Aug 17 11:01:14 user nova-compute[73158]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260] successful.
Aug 17 11:01:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77644af-7049-4241-8139-ee405e600d9e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bb8e0e-b591-47d5-914c-2da68807a914]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:01:14 user nova-compute[73158]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 (non-flash)
Aug 17 11:01:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:01:14 user nova-compute[73158]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 (non-flash)
Aug 17 11:01:14 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to 172.16.0.220:3260 {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73158) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73158) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f9096-2b29-4830-bf9f-bdd24de3cdc2]: (4, ('- - 0', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73158) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:01:14 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdqhKcmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73158) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26233373332336362', 'path': '/dev/sdc'} {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233373332336362', 'path': '/dev/sdc'} {{(pid=73158) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1515254555',display_name='tempest-TestVolumeBootPattern-server-1515254555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1515254555',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-464su7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:01:04Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=91017363-db79-4d0a-9595-6975be41107d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73158) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG nova.objects.instance [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'pci_devices' on Instance uuid 91017363-db79-4d0a-9595-6975be41107d {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:01:15 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:01:15 user nova-compute[73158]:   <uuid>91017363-db79-4d0a-9595-6975be41107d</uuid>
Aug 17 11:01:15 user nova-compute[73158]:   <name>instance-00000034</name>
Aug 17 11:01:15 user nova-compute[73158]:   <memory>524288</memory>
Aug 17 11:01:15 user nova-compute[73158]:   <vcpu>1</vcpu>
Aug 17 11:01:15 user nova-compute[73158]:   <metadata>
Aug 17 11:01:15 user nova-compute[73158]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:01:15 user nova-compute[73158]:       <nova:package version="0.0.0"/>
Aug 17 11:01:15 user nova-compute[73158]:       <nova:name>tempest-TestVolumeBootPattern-server-1515254555</nova:name>
Aug 17 11:01:15 user nova-compute[73158]:       <nova:creationTime>2023-08-17 11:01:14</nova:creationTime>
Aug 17 11:01:15 user nova-compute[73158]:       <nova:flavor name="m1.tiny">
Aug 17 11:01:15 user nova-compute[73158]:         <nova:memory>512</nova:memory>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:disk>1</nova:disk>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:swap>0</nova:swap>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:01:15 user nova-compute[73158]:       </nova:flavor>
Aug 17 11:01:15 user nova-compute[73158]:       <nova:owner>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:user uuid="9d339d632dc04d9996c284a37269ee55">tempest-TestVolumeBootPattern-1100093910-project-member</nova:user>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:project uuid="356b44dd2b2840f19d651e921cb73ba7">tempest-TestVolumeBootPattern-1100093910</nova:project>
Aug 17 11:01:15 user nova-compute[73158]:       </nova:owner>
Aug 17 11:01:15 user nova-compute[73158]:       <nova:ports>
Aug 17 11:01:15 user nova-compute[73158]:         <nova:port uuid="138b9fec-885f-444d-995d-bc4872edf49b">
Aug 17 11:01:15 user nova-compute[73158]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:01:15 user nova-compute[73158]:         </nova:port>
Aug 17 11:01:15 user nova-compute[73158]:       </nova:ports>
Aug 17 11:01:15 user nova-compute[73158]:     </nova:instance>
Aug 17 11:01:15 user nova-compute[73158]:   </metadata>
Aug 17 11:01:15 user nova-compute[73158]:   <sysinfo type="smbios">
Aug 17 11:01:15 user nova-compute[73158]:     <system>
Aug 17 11:01:15 user nova-compute[73158]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:01:15 user nova-compute[73158]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:01:15 user nova-compute[73158]:       <entry name="version">0.0.0</entry>
Aug 17 11:01:15 user nova-compute[73158]:       <entry name="serial">91017363-db79-4d0a-9595-6975be41107d</entry>
Aug 17 11:01:15 user nova-compute[73158]:       <entry name="uuid">91017363-db79-4d0a-9595-6975be41107d</entry>
Aug 17 11:01:15 user nova-compute[73158]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:01:15 user nova-compute[73158]:     </system>
Aug 17 11:01:15 user nova-compute[73158]:   </sysinfo>
Aug 17 11:01:15 user nova-compute[73158]:   <os>
Aug 17 11:01:15 user nova-compute[73158]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:01:15 user nova-compute[73158]:     <boot dev="hd"/>
Aug 17 11:01:15 user nova-compute[73158]:     <smbios mode="sysinfo"/>
Aug 17 11:01:15 user nova-compute[73158]:   </os>
Aug 17 11:01:15 user nova-compute[73158]:   <features>
Aug 17 11:01:15 user nova-compute[73158]:     <acpi/>
Aug 17 11:01:15 user nova-compute[73158]:     <apic/>
Aug 17 11:01:15 user nova-compute[73158]:     <vmcoreinfo/>
Aug 17 11:01:15 user nova-compute[73158]:   </features>
Aug 17 11:01:15 user nova-compute[73158]:   <clock offset="utc">
Aug 17 11:01:15 user nova-compute[73158]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:01:15 user nova-compute[73158]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:01:15 user nova-compute[73158]:     <timer name="hpet" present="no"/>
Aug 17 11:01:15 user nova-compute[73158]:   </clock>
Aug 17 11:01:15 user nova-compute[73158]:   <cpu mode="custom" match="exact">
Aug 17 11:01:15 user nova-compute[73158]:     <model>Nehalem</model>
Aug 17 11:01:15 user nova-compute[73158]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:01:15 user nova-compute[73158]:   </cpu>
Aug 17 11:01:15 user nova-compute[73158]:   <devices>
Aug 17 11:01:15 user nova-compute[73158]:     <disk type="block" device="disk">
Aug 17 11:01:15 user nova-compute[73158]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:01:15 user nova-compute[73158]:       <source dev="/dev/sdc"/>
Aug 17 11:01:15 user nova-compute[73158]:       <target dev="vda" bus="virtio"/>
Aug 17 11:01:15 user nova-compute[73158]:       <serial>4b715de5-4f3b-45eb-a775-6a7760e59be9</serial>
Aug 17 11:01:15 user nova-compute[73158]:     </disk>
Aug 17 11:01:15 user nova-compute[73158]:     <interface type="ethernet">
Aug 17 11:01:15 user nova-compute[73158]:       <mac address="fa:16:3e:f3:c4:d9"/>
Aug 17 11:01:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 11:01:15 user nova-compute[73158]:       <mtu size="1442"/>
Aug 17 11:01:15 user nova-compute[73158]:       <target dev="tap138b9fec-88"/>
Aug 17 11:01:15 user nova-compute[73158]:     </interface>
Aug 17 11:01:15 user nova-compute[73158]:     <serial type="pty">
Aug 17 11:01:15 user nova-compute[73158]:       <log file="/opt/stack/data/nova/instances/91017363-db79-4d0a-9595-6975be41107d/console.log" append="off"/>
Aug 17 11:01:15 user nova-compute[73158]:     </serial>
Aug 17 11:01:15 user nova-compute[73158]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:01:15 user nova-compute[73158]:     <video>
Aug 17 11:01:15 user nova-compute[73158]:       <model type="virtio"/>
Aug 17 11:01:15 user nova-compute[73158]:     </video>
Aug 17 11:01:15 user nova-compute[73158]:     <rng model="virtio">
Aug 17 11:01:15 user nova-compute[73158]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:01:15 user nova-compute[73158]:     </rng>
Aug 17 11:01:15 user nova-compute[73158]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:01:15 user nova-compute[73158]:     <memballoon model="virtio">
Aug 17 11:01:15 user nova-compute[73158]:       <stats period="10"/>
Aug 17 11:01:15 user nova-compute[73158]:     </memballoon>
Aug 17 11:01:15 user nova-compute[73158]:   </devices>
Aug 17 11:01:15 user nova-compute[73158]: </domain>
Aug 17 11:01:15 user nova-compute[73158]:  {{(pid=73158) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1515254555',display_name='tempest-TestVolumeBootPattern-server-1515254555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1515254555',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-464su7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:01:04Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=91017363-db79-4d0a-9595-6975be41107d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG os_vif [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88') {{(pid=73158) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap138b9fec-88, may_exist=True, interface_attrs={}) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap138b9fec-88, col_values=(('external_ids', {'iface-id': '138b9fec-885f-444d-995d-bc4872edf49b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:c4:d9', 'vm-uuid': '91017363-db79-4d0a-9595-6975be41107d'}),), if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:16 user nova-compute[73158]: INFO os_vif [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88')
Aug 17 11:01:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No BDM found with device name vda, not building metadata. {{(pid=73158) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:01:16 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] No VIF found with MAC fa:16:3e:f3:c4:d9, not building metadata {{(pid=73158) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a9935c2-d42f-4a71-8ee8-f4be061167c8 req-97814d6a-d8cf-4aed-ae02-f8191f99e10d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a9935c2-d42f-4a71-8ee8-f4be061167c8 req-97814d6a-d8cf-4aed-ae02-f8191f99e10d service nova] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a9935c2-d42f-4a71-8ee8-f4be061167c8 req-97814d6a-d8cf-4aed-ae02-f8191f99e10d service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-0a9935c2-d42f-4a71-8ee8-f4be061167c8 req-97814d6a-d8cf-4aed-ae02-f8191f99e10d service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:17 user nova-compute[73158]: DEBUG nova.compute.manager [req-0a9935c2-d42f-4a71-8ee8-f4be061167c8 req-97814d6a-d8cf-4aed-ae02-f8191f99e10d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] No waiting events found dispatching network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:01:17 user nova-compute[73158]: WARNING nova.compute.manager [req-0a9935c2-d42f-4a71-8ee8-f4be061167c8 req-97814d6a-d8cf-4aed-ae02-f8191f99e10d service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received unexpected event network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b for instance with vm_state building and task_state spawning.
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692270079.506107, 91017363-db79-4d0a-9595-6975be41107d => Resumed> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] VM Resumed (Lifecycle Event)
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Instance event wait completed in 0 seconds for  {{(pid=73158) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Guest created on hypervisor {{(pid=73158) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] Instance spawned successfully.
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Found default for hw_cdrom_bus of ide {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Found default for hw_disk_bus of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Found default for hw_input_bus of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Found default for hw_pointer_model of None {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Found default for hw_video_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Found default for hw_vif_model of virtio {{(pid=73158) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.virt.driver [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] Emitting event <LifecycleEvent: 1692270079.5073736, 91017363-db79-4d0a-9595-6975be41107d => Started> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] VM Started (Lifecycle Event)
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73158) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.compute.manager [None req-3f211521-6456-495d-bcbc-cc693482de78 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-cabf3a90-1f88-4f17-9b88-c7982b9ceed6 req-05da41b7-1be5-4a41-995f-1f12f2a2b87f service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cabf3a90-1f88-4f17-9b88-c7982b9ceed6 req-05da41b7-1be5-4a41-995f-1f12f2a2b87f service nova] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cabf3a90-1f88-4f17-9b88-c7982b9ceed6 req-05da41b7-1be5-4a41-995f-1f12f2a2b87f service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cabf3a90-1f88-4f17-9b88-c7982b9ceed6 req-05da41b7-1be5-4a41-995f-1f12f2a2b87f service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:19 user nova-compute[73158]: DEBUG nova.compute.manager [req-cabf3a90-1f88-4f17-9b88-c7982b9ceed6 req-05da41b7-1be5-4a41-995f-1f12f2a2b87f service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] No waiting events found dispatching network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:01:19 user nova-compute[73158]: WARNING nova.compute.manager [req-cabf3a90-1f88-4f17-9b88-c7982b9ceed6 req-05da41b7-1be5-4a41-995f-1f12f2a2b87f service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received unexpected event network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b for instance with vm_state active and task_state None.
Aug 17 11:01:19 user nova-compute[73158]: INFO nova.compute.manager [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Took 16.33 seconds to build instance.
Aug 17 11:01:19 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-c51cff55-075a-43b9-b233-ed16d236427e tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "91017363-db79-4d0a-9595-6975be41107d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.436s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:01:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:01:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:01:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:01:57 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:02:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Forcefully refreshing network info cache for instance {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG nova.objects.instance [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lazy-loading 'info_cache' on Instance uuid 1527b230-f5eb-40c5-8fe6-09ba14499744 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG nova.network.neutron [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:02:04 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updated the network info_cache for instance {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:02:06 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:02:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:11 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:02:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:02:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:02:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=24.135726928710938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:02:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 1527b230-f5eb-40c5-8fe6-09ba14499744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 91017363-db79-4d0a-9595-6975be41107d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:02:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:02:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:02:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:16 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:21 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:26 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:28 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:02:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:31 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:36 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:41 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:02:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:02:46 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:51 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:54 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-changed-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG nova.compute.manager [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Refreshing instance network info cache due to event network-changed-138b9fec-885f-444d-995d-bc4872edf49b. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] Acquiring lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] Acquired lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG nova.network.neutron [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Refreshing network info cache for port 138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG nova.network.neutron [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updated VIF entry in instance network info cache for port 138b9fec-885f-444d-995d-bc4872edf49b. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG nova.network.neutron [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updating instance_info_cache with network_info: [{"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:02:55 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-cfdd776f-9d27-4637-ac4c-271f9e3688e2 req-24543c2a-ed02-4777-8cbe-0d92e9ac4ac1 service nova] Releasing lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:02:56 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:56 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-changed-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Refreshing instance network info cache due to event network-changed-138b9fec-885f-444d-995d-bc4872edf49b. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] Acquiring lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] Acquired lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.network.neutron [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Refreshing network info cache for port 138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "91017363-db79-4d0a-9595-6975be41107d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "91017363-db79-4d0a-9595-6975be41107d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "91017363-db79-4d0a-9595-6975be41107d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:02:57 user nova-compute[73158]: INFO nova.compute.manager [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Terminating instance
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.compute.manager [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-6ec8591c-df75-476a-b602-d2c03347d564 req-4b47e4c7-2318-422a-9990-c5b595b0bae4 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-vif-unplugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6ec8591c-df75-476a-b602-d2c03347d564 req-4b47e4c7-2318-422a-9990-c5b595b0bae4 service nova] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6ec8591c-df75-476a-b602-d2c03347d564 req-4b47e4c7-2318-422a-9990-c5b595b0bae4 service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-6ec8591c-df75-476a-b602-d2c03347d564 req-4b47e4c7-2318-422a-9990-c5b595b0bae4 service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-6ec8591c-df75-476a-b602-d2c03347d564 req-4b47e4c7-2318-422a-9990-c5b595b0bae4 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] No waiting events found dispatching network-vif-unplugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:02:57 user nova-compute[73158]: DEBUG nova.compute.manager [req-6ec8591c-df75-476a-b602-d2c03347d564 req-4b47e4c7-2318-422a-9990-c5b595b0bae4 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-vif-unplugged-138b9fec-885f-444d-995d-bc4872edf49b for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updated VIF entry in instance network info cache for port 138b9fec-885f-444d-995d-bc4872edf49b. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.network.neutron [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updating instance_info_cache with network_info: [{"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-3d1129f3-492c-4fd1-ab3f-fffc2b06d2c2 req-d6015046-69d7-41d2-b37e-6fca3ea59c0c service nova] Releasing lock "refresh_cache-91017363-db79-4d0a-9595-6975be41107d" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] Instance destroyed successfully.
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.objects.instance [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'resources' on Instance uuid 91017363-db79-4d0a-9595-6975be41107d {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1515254555',display_name='tempest-TestVolumeBootPattern-server-1515254555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1515254555',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:01:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-464su7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:01:20Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=91017363-db79-4d0a-9595-6975be41107d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "138b9fec-885f-444d-995d-bc4872edf49b", "address": "fa:16:3e:f3:c4:d9", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138b9fec-88", "ovs_interfaceid": "138b9fec-885f-444d-995d-bc4872edf49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_vif [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap138b9fec-88, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:02:58 user nova-compute[73158]: INFO os_vif [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=138b9fec-885f-444d-995d-bc4872edf49b,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138b9fec-88')
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdqhKcmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:02:58 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb77347-ef65-460d-87c5-351433cbdbfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7d836e-f90a-4fb7-9515-e1c1c8caf29d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:02:58 user nova-compute[73158]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 (non-flash)
Aug 17 11:02:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:02:58 user nova-compute[73158]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 (non-flash)
Aug 17 11:02:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc6d1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9'): ({'sdc'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Removing single pathed devices sdc {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed58a965-b4d1-4341-9f35-5069d357e7c5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42cec6-f3a5-4872-b92f-f2385dbadfc9]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flushing IO for device /dev/sdc {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[defc89c0-a2b7-40d9-beb1-72f20a3f74a0]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73f2e8-c5fc-45bb-bd07-d57ec6b1a72b]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] SCSI volumes sdc have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5702866b', '/dev/disk/by-id/scsi-26233373332336362', '/dev/disk/by-id/scsi-1SCST_BIO5702866b-b37323cbdb551139') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600d58c-ab42-4cda-996c-a49a5b1cc6ec]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f28d13-fe8f-4360-ac94-75f0603f3ebe]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e786b5-6598-4180-aec1-a1ea3a1ab5f1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260]
Aug 17 11:02:58 user nova-compute[73158]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9, portal: 172.16.0.220,3260] successful.
Aug 17 11:02:58 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b715de5-4f3b-45eb-a775-6a7760e59be9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8f3318-9a41-4bcb-80eb-c8260b5891b5]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== disconnect_volume: return (279ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:02:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Deleting instance files /opt/stack/data/nova/instances/91017363-db79-4d0a-9595-6975be41107d_del
Aug 17 11:02:58 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Deletion of /opt/stack/data/nova/instances/91017363-db79-4d0a-9595-6975be41107d_del complete
Aug 17 11:02:58 user nova-compute[73158]: INFO nova.compute.manager [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 17 11:02:58 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:02:58 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:02:59 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:02:59 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] Took 0.86 seconds to deallocate network for instance.
Aug 17 11:02:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:02:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] Acquiring lock "91017363-db79-4d0a-9595-6975be41107d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:02:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:02:59 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] Lock "91017363-db79-4d0a-9595-6975be41107d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:02:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] No waiting events found dispatching network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:02:59 user nova-compute[73158]: WARNING nova.compute.manager [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received unexpected event network-vif-plugged-138b9fec-885f-444d-995d-bc4872edf49b for instance with vm_state active and task_state deleting.
Aug 17 11:02:59 user nova-compute[73158]: DEBUG nova.compute.manager [req-f5790799-055e-42ea-823b-ab0a2082c85b req-12c31bfd-9948-43a7-b6f0-57b6eef4ca85 service nova] [instance: 91017363-db79-4d0a-9595-6975be41107d] Received event network-vif-deleted-138b9fec-885f-444d-995d-bc4872edf49b {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:03:00 user nova-compute[73158]: INFO nova.compute.manager [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 91017363-db79-4d0a-9595-6975be41107d] Took 1.02 seconds to detach 1 volumes for instance.
Aug 17 11:03:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:03:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:03:00 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:03:00 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:03:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:03:00 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Deleted allocations for instance 91017363-db79-4d0a-9595-6975be41107d
Aug 17 11:03:00 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-4a73ddc8-a178-4800-b73a-20b8aa8daa51 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "91017363-db79-4d0a-9595-6975be41107d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:03:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:03:03 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:05 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:03:05 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:03:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:08 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692270178.2926896, 91017363-db79-4d0a-9595-6975be41107d => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:03:13 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 91017363-db79-4d0a-9595-6975be41107d] VM Stopped (Lifecycle Event)
Aug 17 11:03:13 user nova-compute[73158]: DEBUG nova.compute.manager [None req-812ccb5d-4c95-427f-a50f-ab020d9f5dd9 None None] [instance: 91017363-db79-4d0a-9595-6975be41107d] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73158) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:03:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:03:13 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:03:13 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=24.134872436523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:03:13 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Instance 1527b230-f5eb-40c5-8fe6-09ba14499744 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73158) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing inventories for resource provider 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating ProviderTree inventory for provider 6683a228-d116-40aa-bd44-73677ce911ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Updating inventory in ProviderTree for provider 6683a228-d116-40aa-bd44-73677ce911ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing aggregate associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, aggregates: None {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Refreshing trait associations for resource provider 6683a228-d116-40aa-bd44-73677ce911ae, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=73158) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:03:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:18 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73158) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 11:03:23 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:28 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:33 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:35 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:36 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:03:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Cleaning up deleted instances {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 11:03:36 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] There are 0 instances to clean {{(pid=73158) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 11:03:38 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:43 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:03:48 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:53 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:58 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:03:58 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-changed-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG nova.compute.manager [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Refreshing instance network info cache due to event network-changed-5aaa7a5e-7912-4bd0-9fdb-649c83a22878. {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] Acquiring lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] Acquired lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG nova.network.neutron [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Refreshing network info cache for port 5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:04:01 user nova-compute[73158]: INFO nova.compute.manager [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Terminating instance
Aug 17 11:04:01 user nova-compute[73158]: DEBUG nova.compute.manager [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Start destroying the instance on the hypervisor. {{(pid=73158) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-30acc714-395c-448d-8f42-e88a3f004a91 req-f6ee3375-4709-41b6-aa7e-f9fc25e46a21 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-vif-unplugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-30acc714-395c-448d-8f42-e88a3f004a91 req-f6ee3375-4709-41b6-aa7e-f9fc25e46a21 service nova] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-30acc714-395c-448d-8f42-e88a3f004a91 req-f6ee3375-4709-41b6-aa7e-f9fc25e46a21 service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-30acc714-395c-448d-8f42-e88a3f004a91 req-f6ee3375-4709-41b6-aa7e-f9fc25e46a21 service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-30acc714-395c-448d-8f42-e88a3f004a91 req-f6ee3375-4709-41b6-aa7e-f9fc25e46a21 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] No waiting events found dispatching network-vif-unplugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.compute.manager [req-30acc714-395c-448d-8f42-e88a3f004a91 req-f6ee3375-4709-41b6-aa7e-f9fc25e46a21 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-vif-unplugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 for instance with task_state deleting. {{(pid=73158) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:04:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Instance destroyed successfully.
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.objects.instance [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lazy-loading 'resources' on Instance uuid 1527b230-f5eb-40c5-8fe6-09ba14499744 {{(pid=73158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.vif [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T10:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1454175146',display_name='tempest-TestVolumeBootPattern-server-1454175146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1454175146',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8dwwAj8O6XgPlQ1jCvpl8Asdq5dGYxN9iQABhWwq3+ASp3DiqImiYRxHmUH8aIxisnrAYOnatOBxWICGBwQBClYwKcpDkF1Dm5ts6mUEelAKEfUKXnQx4/EJ62qFU0w==',key_name='tempest-TestVolumeBootPattern-1015787603',keypairs=<?>,launch_index=0,launched_at=2023-08-17T10:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='356b44dd2b2840f19d651e921cb73ba7',ramdisk_id='',reservation_id='r-0r7npzih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1100093910',owner_user_name='tempest-TestVolumeBootPattern-1100093910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T10:59:20Z,user_data=None,user_id='9d339d632dc04d9996c284a37269ee55',uuid=1527b230-f5eb-40c5-8fe6-09ba14499744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converting VIF {"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.network.os_vif_util [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79') {{(pid=73158) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_vif [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79') {{(pid=73158) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5aaa7a5e-79, bridge=br-int, if_exists=True) {{(pid=73158) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:04:02 user nova-compute[73158]: INFO os_vif [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7a5e-7912-4bd0-9fdb-649c83a22878,network=Network(bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7a5e-79')
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] calling os-brick to detach iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcc3c151c60>, {'target_iqns': ['iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGwhsmUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:04:02 user nova-compute[73158]: WARNING os_brick.initiator.connectors.base [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600', 0)] {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[960dab87-6f0e-4123-a88a-2632b5185a28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee6cb3-df36-4c43-a609-e499a0b4e608]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:04:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 (non-flash)
Aug 17 11:04:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcbfc6df400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600'): ({'sdb'}, set())}) {{(pid=73158) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Removing single pathed devices sdb {{(pid=73158) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2bf4d-6dab-4d37-ac43-6beca8e44576]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updated VIF entry in instance network info cache for port 5aaa7a5e-7912-4bd0-9fdb-649c83a22878. {{(pid=73158) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.network.neutron [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [{"id": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "address": "fa:16:3e:1c:d3:41", "network": {"id": "bbc9c265-7bb2-4f1f-b4c2-8126ae47abcc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-79351953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "356b44dd2b2840f19d651e921cb73ba7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7a5e-79", "ovs_interfaceid": "5aaa7a5e-7912-4bd0-9fdb-649c83a22878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-2c49f2e9-1843-402d-83d2-5c6905475245 req-1d33e102-373c-4a04-bf2f-50cae5494e68 service nova] Releasing lock "refresh_cache-1527b230-f5eb-40c5-8fe6-09ba14499744" {{(pid=73158) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bcdb50-87b9-48cd-b004-4606b7b30da7]: (4, ('ok\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Flushing IO for device /dev/sdb {{(pid=73158) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0ab853-fe8e-4513-a406-a006b43e5f3e]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73158) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc0d1c-200d-46a3-a32f-7ab2f307e694]: (4, ('1', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.linuxscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] SCSI volumes sdb have been removed. {{(pid=73158) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6f41af80', '/dev/disk/by-id/scsi-23338656430636664', '/dev/disk/by-id/scsi-1SCST_BIO6f41af80-38ed0cfdd2b88b93') {{(pid=84001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5823a15-f327-4779-9686-4816f29079f7]: (4, None) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600')] {{(pid=73158) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7feba4-1de0-403c-a5d9-9367d352def8]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --logout {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1382fda6-4152-4609-8811-6e7fa8f16e2b]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260]
Aug 17 11:04:02 user nova-compute[73158]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600, portal: 172.16.0.220,3260] successful.
Aug 17 11:04:02 user nova-compute[73158]:  stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op delete {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d93d8c-d592-4d49-8f7b-25cb7f636600 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bbc9fa-ec6b-4a4e-ab7a-67e74d8b644c]: (4, ('', '')) {{(pid=84001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73158) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.base [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG os_brick.initiator.connectors.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] <== disconnect_volume: return (287ms) None {{(pid=73158) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Disconnected iSCSI Volume {{(pid=73158) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:04:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Deleting instance files /opt/stack/data/nova/instances/1527b230-f5eb-40c5-8fe6-09ba14499744_del
Aug 17 11:04:02 user nova-compute[73158]: INFO nova.virt.libvirt.driver [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Deletion of /opt/stack/data/nova/instances/1527b230-f5eb-40c5-8fe6-09ba14499744_del complete
Aug 17 11:04:02 user nova-compute[73158]: INFO nova.compute.manager [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 17 11:04:02 user nova-compute[73158]: DEBUG oslo.service.loopingcall [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73158) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.compute.manager [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Deallocating network for instance {{(pid=73158) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:04:02 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] deallocate_for_instance() {{(pid=73158) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:04:03 user nova-compute[73158]: DEBUG nova.network.neutron [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Updating instance_info_cache with network_info: [] {{(pid=73158) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:04:03 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Took 0.50 seconds to deallocate network for instance.
Aug 17 11:04:03 user nova-compute[73158]: INFO nova.compute.manager [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Took 0.82 seconds to detach 1 volumes for instance.
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] Acquiring lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] No waiting events found dispatching network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:04:04 user nova-compute[73158]: WARNING nova.compute.manager [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received unexpected event network-vif-plugged-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 for instance with vm_state deleted and task_state None.
Aug 17 11:04:04 user nova-compute[73158]: DEBUG nova.compute.manager [req-280a736e-7a2d-4585-b7fe-38fd2b462e6d req-5467f3a6-f36c-4445-ba33-38598e3efc87 service nova] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Received event network-vif-deleted-5aaa7a5e-7912-4bd0-9fdb-649c83a22878 {{(pid=73158) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:04 user nova-compute[73158]: INFO nova.scheduler.client.report [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Deleted allocations for instance 1527b230-f5eb-40c5-8fe6-09ba14499744
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-e167e4cc-0af4-4858-9419-275360dcd998 tempest-TestVolumeBootPattern-1100093910 tempest-TestVolumeBootPattern-1100093910-project-member] Lock "1527b230-f5eb-40c5-8fe6-09ba14499744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:04 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:04:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:04:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:04:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:07 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:07 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:04:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:04:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:04:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:04:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:04:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:04:14 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:04:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=24.133949279785156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:04:14 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:04:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:04:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:04:17 user nova-compute[73158]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692270242.2437115, 1527b230-f5eb-40c5-8fe6-09ba14499744 => Stopped> {{(pid=73158) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:04:17 user nova-compute[73158]: INFO nova.compute.manager [-] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] VM Stopped (Lifecycle Event)
Aug 17 11:04:17 user nova-compute[73158]: DEBUG nova.compute.manager [None req-3579fae7-7cdd-4455-8942-ebacfc81bc4e None None] [instance: 1527b230-f5eb-40c5-8fe6-09ba14499744] Checking state {{(pid=73158) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:04:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:04:29 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:04:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:37 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:04:42 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:04:47 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:52 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:04:57 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:05:00 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:01 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:02 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:03 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:03 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73158) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:05:05 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Starting heal instance info cache {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Rebuilding the list of instances to heal {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG nova.compute.manager [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Didn't find any instances for network info cache update. {{(pid=73158) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:06 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:07 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:08 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:08 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:12 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG oslo_service.periodic_task [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73158) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73158) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:05:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:05:15 user nova-compute[73158]: WARNING nova.virt.libvirt.driver [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:05:15 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Hypervisor/Node resource view: name=user free_ram=9052MB free_disk=24.13219451904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73158) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:05:15 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:05:16 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:05:16 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73158) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:05:16 user nova-compute[73158]: DEBUG nova.compute.provider_tree [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed in ProviderTree for provider: 6683a228-d116-40aa-bd44-73677ce911ae {{(pid=73158) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:05:16 user nova-compute[73158]: DEBUG nova.scheduler.client.report [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Inventory has not changed for provider 6683a228-d116-40aa-bd44-73677ce911ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73158) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:05:16 user nova-compute[73158]: DEBUG nova.compute.resource_tracker [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Compute_service record updated for user:user {{(pid=73158) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:05:16 user nova-compute[73158]: DEBUG oslo_concurrency.lockutils [None req-23ffc0ff-2f57-4819-b4ea-40ef3b3c52a0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=73158) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:05:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:05:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73158) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:05:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:05:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73158) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:05:17 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:22 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:27 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:05:32 user nova-compute[73158]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73158) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}